• Watch
    Notifications
  • Fork

    Fork CSYE_7245

    If this dialog fails to load, you can visit the fork page directly.

/CSYE_7245

Permalink
Branch: master
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
21437 lines (20661 sloc) 550 KB
<!DOCTYPE html>
<html>
<head><meta charset="utf-8" />
<title>H2O_automl_model</title><script src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.1.10/require.min.js"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.0.3/jquery.min.js"></script>
<style type="text/css">
/*!
*
* Twitter Bootstrap
*
*/
/*!
* Bootstrap v3.3.7 (http://getbootstrap.com)
* Copyright 2011-2016 Twitter, Inc.
* Licensed under MIT (https://github.com/twbs/bootstrap/blob/master/LICENSE)
*/
/*! normalize.css v3.0.3 | MIT License | github.com/necolas/normalize.css */
html {
font-family: sans-serif;
-ms-text-size-adjust: 100%;
-webkit-text-size-adjust: 100%;
}
body {
margin: 0;
}
article,
aside,
details,
figcaption,
figure,
footer,
header,
hgroup,
main,
menu,
nav,
section,
summary {
display: block;
}
audio,
canvas,
progress,
video {
display: inline-block;
vertical-align: baseline;
}
audio:not([controls]) {
display: none;
height: 0;
}
[hidden],
template {
display: none;
}
a {
background-color: transparent;
}
a:active,
a:hover {
outline: 0;
}
abbr[title] {
border-bottom: 1px dotted;
}
b,
strong {
font-weight: bold;
}
dfn {
font-style: italic;
}
h1 {
font-size: 2em;
margin: 0.67em 0;
}
mark {
background: #ff0;
color: #000;
}
small {
font-size: 80%;
}
sub,
sup {
font-size: 75%;
line-height: 0;
position: relative;
vertical-align: baseline;
}
sup {
top: -0.5em;
}
sub {
bottom: -0.25em;
}
img {
border: 0;
}
svg:not(:root) {
overflow: hidden;
}
figure {
margin: 1em 40px;
}
hr {
box-sizing: content-box;
height: 0;
}
pre {
overflow: auto;
}
code,
kbd,
pre,
samp {
font-family: monospace, monospace;
font-size: 1em;
}
button,
input,
optgroup,
select,
textarea {
color: inherit;
font: inherit;
margin: 0;
}
button {
overflow: visible;
}
button,
select {
text-transform: none;
}
button,
html input[type="button"],
input[type="reset"],
input[type="submit"] {
-webkit-appearance: button;
cursor: pointer;
}
button[disabled],
html input[disabled] {
cursor: default;
}
button::-moz-focus-inner,
input::-moz-focus-inner {
border: 0;
padding: 0;
}
input {
line-height: normal;
}
input[type="checkbox"],
input[type="radio"] {
box-sizing: border-box;
padding: 0;
}
input[type="number"]::-webkit-inner-spin-button,
input[type="number"]::-webkit-outer-spin-button {
height: auto;
}
input[type="search"] {
-webkit-appearance: textfield;
box-sizing: content-box;
}
input[type="search"]::-webkit-search-cancel-button,
input[type="search"]::-webkit-search-decoration {
-webkit-appearance: none;
}
fieldset {
border: 1px solid #c0c0c0;
margin: 0 2px;
padding: 0.35em 0.625em 0.75em;
}
legend {
border: 0;
padding: 0;
}
textarea {
overflow: auto;
}
optgroup {
font-weight: bold;
}
table {
border-collapse: collapse;
border-spacing: 0;
}
td,
th {
padding: 0;
}
/*! Source: https://github.com/h5bp/html5-boilerplate/blob/master/src/css/main.css */
@media print {
*,
*:before,
*:after {
background: transparent !important;
color: #000 !important;
box-shadow: none !important;
text-shadow: none !important;
}
a,
a:visited {
text-decoration: underline;
}
a[href]:after {
content: " (" attr(href) ")";
}
abbr[title]:after {
content: " (" attr(title) ")";
}
a[href^="#"]:after,
a[href^="javascript:"]:after {
content: "";
}
pre,
blockquote {
border: 1px solid #999;
page-break-inside: avoid;
}
thead {
display: table-header-group;
}
tr,
img {
page-break-inside: avoid;
}
img {
max-width: 100% !important;
}
p,
h2,
h3 {
orphans: 3;
widows: 3;
}
h2,
h3 {
page-break-after: avoid;
}
.navbar {
display: none;
}
.btn > .caret,
.dropup > .btn > .caret {
border-top-color: #000 !important;
}
.label {
border: 1px solid #000;
}
.table {
border-collapse: collapse !important;
}
.table td,
.table th {
background-color: #fff !important;
}
.table-bordered th,
.table-bordered td {
border: 1px solid #ddd !important;
}
}
@font-face {
font-family: 'Glyphicons Halflings';
src: url('../components/bootstrap/fonts/glyphicons-halflings-regular.eot');
src: url('../components/bootstrap/fonts/glyphicons-halflings-regular.eot?#iefix') format('embedded-opentype'), url('../components/bootstrap/fonts/glyphicons-halflings-regular.woff2') format('woff2'), url('../components/bootstrap/fonts/glyphicons-halflings-regular.woff') format('woff'), url('../components/bootstrap/fonts/glyphicons-halflings-regular.ttf') format('truetype'), url('../components/bootstrap/fonts/glyphicons-halflings-regular.svg#glyphicons_halflingsregular') format('svg');
}
.glyphicon {
position: relative;
top: 1px;
display: inline-block;
font-family: 'Glyphicons Halflings';
font-style: normal;
font-weight: normal;
line-height: 1;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
}
.glyphicon-asterisk:before {
content: "\002a";
}
.glyphicon-plus:before {
content: "\002b";
}
.glyphicon-euro:before,
.glyphicon-eur:before {
content: "\20ac";
}
.glyphicon-minus:before {
content: "\2212";
}
.glyphicon-cloud:before {
content: "\2601";
}
.glyphicon-envelope:before {
content: "\2709";
}
.glyphicon-pencil:before {
content: "\270f";
}
.glyphicon-glass:before {
content: "\e001";
}
.glyphicon-music:before {
content: "\e002";
}
.glyphicon-search:before {
content: "\e003";
}
.glyphicon-heart:before {
content: "\e005";
}
.glyphicon-star:before {
content: "\e006";
}
.glyphicon-star-empty:before {
content: "\e007";
}
.glyphicon-user:before {
content: "\e008";
}
.glyphicon-film:before {
content: "\e009";
}
.glyphicon-th-large:before {
content: "\e010";
}
.glyphicon-th:before {
content: "\e011";
}
.glyphicon-th-list:before {
content: "\e012";
}
.glyphicon-ok:before {
content: "\e013";
}
.glyphicon-remove:before {
content: "\e014";
}
.glyphicon-zoom-in:before {
content: "\e015";
}
.glyphicon-zoom-out:before {
content: "\e016";
}
.glyphicon-off:before {
content: "\e017";
}
.glyphicon-signal:before {
content: "\e018";
}
.glyphicon-cog:before {
content: "\e019";
}
.glyphicon-trash:before {
content: "\e020";
}
.glyphicon-home:before {
content: "\e021";
}
.glyphicon-file:before {
content: "\e022";
}
.glyphicon-time:before {
content: "\e023";
}
.glyphicon-road:before {
content: "\e024";
}
.glyphicon-download-alt:before {
content: "\e025";
}
.glyphicon-download:before {
content: "\e026";
}
.glyphicon-upload:before {
content: "\e027";
}
.glyphicon-inbox:before {
content: "\e028";
}
.glyphicon-play-circle:before {
content: "\e029";
}
.glyphicon-repeat:before {
content: "\e030";
}
.glyphicon-refresh:before {
content: "\e031";
}
.glyphicon-list-alt:before {
content: "\e032";
}
.glyphicon-lock:before {
content: "\e033";
}
.glyphicon-flag:before {
content: "\e034";
}
.glyphicon-headphones:before {
content: "\e035";
}
.glyphicon-volume-off:before {
content: "\e036";
}
.glyphicon-volume-down:before {
content: "\e037";
}
.glyphicon-volume-up:before {
content: "\e038";
}
.glyphicon-qrcode:before {
content: "\e039";
}
.glyphicon-barcode:before {
content: "\e040";
}
.glyphicon-tag:before {
content: "\e041";
}
.glyphicon-tags:before {
content: "\e042";
}
.glyphicon-book:before {
content: "\e043";
}
.glyphicon-bookmark:before {
content: "\e044";
}
.glyphicon-print:before {
content: "\e045";
}
.glyphicon-camera:before {
content: "\e046";
}
.glyphicon-font:before {
content: "\e047";
}
.glyphicon-bold:before {
content: "\e048";
}
.glyphicon-italic:before {
content: "\e049";
}
.glyphicon-text-height:before {
content: "\e050";
}
.glyphicon-text-width:before {
content: "\e051";
}
.glyphicon-align-left:before {
content: "\e052";
}
.glyphicon-align-center:before {
content: "\e053";
}
.glyphicon-align-right:before {
content: "\e054";
}
.glyphicon-align-justify:before {
content: "\e055";
}
.glyphicon-list:before {
content: "\e056";
}
.glyphicon-indent-left:before {
content: "\e057";
}
.glyphicon-indent-right:before {
content: "\e058";
}
.glyphicon-facetime-video:before {
content: "\e059";
}
.glyphicon-picture:before {
content: "\e060";
}
.glyphicon-map-marker:before {
content: "\e062";
}
.glyphicon-adjust:before {
content: "\e063";
}
.glyphicon-tint:before {
content: "\e064";
}
.glyphicon-edit:before {
content: "\e065";
}
.glyphicon-share:before {
content: "\e066";
}
.glyphicon-check:before {
content: "\e067";
}
.glyphicon-move:before {
content: "\e068";
}
.glyphicon-step-backward:before {
content: "\e069";
}
.glyphicon-fast-backward:before {
content: "\e070";
}
.glyphicon-backward:before {
content: "\e071";
}
.glyphicon-play:before {
content: "\e072";
}
.glyphicon-pause:before {
content: "\e073";
}
.glyphicon-stop:before {
content: "\e074";
}
.glyphicon-forward:before {
content: "\e075";
}
.glyphicon-fast-forward:before {
content: "\e076";
}
.glyphicon-step-forward:before {
content: "\e077";
}
.glyphicon-eject:before {
content: "\e078";
}
.glyphicon-chevron-left:before {
content: "\e079";
}
.glyphicon-chevron-right:before {
content: "\e080";
}
.glyphicon-plus-sign:before {
content: "\e081";
}
.glyphicon-minus-sign:before {
content: "\e082";
}
.glyphicon-remove-sign:before {
content: "\e083";
}
.glyphicon-ok-sign:before {
content: "\e084";
}
.glyphicon-question-sign:before {
content: "\e085";
}
.glyphicon-info-sign:before {
content: "\e086";
}
.glyphicon-screenshot:before {
content: "\e087";
}
.glyphicon-remove-circle:before {
content: "\e088";
}
.glyphicon-ok-circle:before {
content: "\e089";
}
.glyphicon-ban-circle:before {
content: "\e090";
}
.glyphicon-arrow-left:before {
content: "\e091";
}
.glyphicon-arrow-right:before {
content: "\e092";
}
.glyphicon-arrow-up:before {
content: "\e093";
}
.glyphicon-arrow-down:before {
content: "\e094";
}
.glyphicon-share-alt:before {
content: "\e095";
}
.glyphicon-resize-full:before {
content: "\e096";
}
.glyphicon-resize-small:before {
content: "\e097";
}
.glyphicon-exclamation-sign:before {
content: "\e101";
}
.glyphicon-gift:before {
content: "\e102";
}
.glyphicon-leaf:before {
content: "\e103";
}
.glyphicon-fire:before {
content: "\e104";
}
.glyphicon-eye-open:before {
content: "\e105";
}
.glyphicon-eye-close:before {
content: "\e106";
}
.glyphicon-warning-sign:before {
content: "\e107";
}
.glyphicon-plane:before {
content: "\e108";
}
.glyphicon-calendar:before {
content: "\e109";
}
.glyphicon-random:before {
content: "\e110";
}
.glyphicon-comment:before {
content: "\e111";
}
.glyphicon-magnet:before {
content: "\e112";
}
.glyphicon-chevron-up:before {
content: "\e113";
}
.glyphicon-chevron-down:before {
content: "\e114";
}
.glyphicon-retweet:before {
content: "\e115";
}
.glyphicon-shopping-cart:before {
content: "\e116";
}
.glyphicon-folder-close:before {
content: "\e117";
}
.glyphicon-folder-open:before {
content: "\e118";
}
.glyphicon-resize-vertical:before {
content: "\e119";
}
.glyphicon-resize-horizontal:before {
content: "\e120";
}
.glyphicon-hdd:before {
content: "\e121";
}
.glyphicon-bullhorn:before {
content: "\e122";
}
.glyphicon-bell:before {
content: "\e123";
}
.glyphicon-certificate:before {
content: "\e124";
}
.glyphicon-thumbs-up:before {
content: "\e125";
}
.glyphicon-thumbs-down:before {
content: "\e126";
}
.glyphicon-hand-right:before {
content: "\e127";
}
.glyphicon-hand-left:before {
content: "\e128";
}
.glyphicon-hand-up:before {
content: "\e129";
}
.glyphicon-hand-down:before {
content: "\e130";
}
.glyphicon-circle-arrow-right:before {
content: "\e131";
}
.glyphicon-circle-arrow-left:before {
content: "\e132";
}
.glyphicon-circle-arrow-up:before {
content: "\e133";
}
.glyphicon-circle-arrow-down:before {
content: "\e134";
}
.glyphicon-globe:before {
content: "\e135";
}
.glyphicon-wrench:before {
content: "\e136";
}
.glyphicon-tasks:before {
content: "\e137";
}
.glyphicon-filter:before {
content: "\e138";
}
.glyphicon-briefcase:before {
content: "\e139";
}
.glyphicon-fullscreen:before {
content: "\e140";
}
.glyphicon-dashboard:before {
content: "\e141";
}
.glyphicon-paperclip:before {
content: "\e142";
}
.glyphicon-heart-empty:before {
content: "\e143";
}
.glyphicon-link:before {
content: "\e144";
}
.glyphicon-phone:before {
content: "\e145";
}
.glyphicon-pushpin:before {
content: "\e146";
}
.glyphicon-usd:before {
content: "\e148";
}
.glyphicon-gbp:before {
content: "\e149";
}
.glyphicon-sort:before {
content: "\e150";
}
.glyphicon-sort-by-alphabet:before {
content: "\e151";
}
.glyphicon-sort-by-alphabet-alt:before {
content: "\e152";
}
.glyphicon-sort-by-order:before {
content: "\e153";
}
.glyphicon-sort-by-order-alt:before {
content: "\e154";
}
.glyphicon-sort-by-attributes:before {
content: "\e155";
}
.glyphicon-sort-by-attributes-alt:before {
content: "\e156";
}
.glyphicon-unchecked:before {
content: "\e157";
}
.glyphicon-expand:before {
content: "\e158";
}
.glyphicon-collapse-down:before {
content: "\e159";
}
.glyphicon-collapse-up:before {
content: "\e160";
}
.glyphicon-log-in:before {
content: "\e161";
}
.glyphicon-flash:before {
content: "\e162";
}
.glyphicon-log-out:before {
content: "\e163";
}
.glyphicon-new-window:before {
content: "\e164";
}
.glyphicon-record:before {
content: "\e165";
}
.glyphicon-save:before {
content: "\e166";
}
.glyphicon-open:before {
content: "\e167";
}
.glyphicon-saved:before {
content: "\e168";
}
.glyphicon-import:before {
content: "\e169";
}
.glyphicon-export:before {
content: "\e170";
}
.glyphicon-send:before {
content: "\e171";
}
.glyphicon-floppy-disk:before {
content: "\e172";
}
.glyphicon-floppy-saved:before {
content: "\e173";
}
.glyphicon-floppy-remove:before {
content: "\e174";
}
.glyphicon-floppy-save:before {
content: "\e175";
}
.glyphicon-floppy-open:before {
content: "\e176";
}
.glyphicon-credit-card:before {
content: "\e177";
}
.glyphicon-transfer:before {
content: "\e178";
}
.glyphicon-cutlery:before {
content: "\e179";
}
.glyphicon-header:before {
content: "\e180";
}
.glyphicon-compressed:before {
content: "\e181";
}
.glyphicon-earphone:before {
content: "\e182";
}
.glyphicon-phone-alt:before {
content: "\e183";
}
.glyphicon-tower:before {
content: "\e184";
}
.glyphicon-stats:before {
content: "\e185";
}
.glyphicon-sd-video:before {
content: "\e186";
}
.glyphicon-hd-video:before {
content: "\e187";
}
.glyphicon-subtitles:before {
content: "\e188";
}
.glyphicon-sound-stereo:before {
content: "\e189";
}
.glyphicon-sound-dolby:before {
content: "\e190";
}
.glyphicon-sound-5-1:before {
content: "\e191";
}
.glyphicon-sound-6-1:before {
content: "\e192";
}
.glyphicon-sound-7-1:before {
content: "\e193";
}
.glyphicon-copyright-mark:before {
content: "\e194";
}
.glyphicon-registration-mark:before {
content: "\e195";
}
.glyphicon-cloud-download:before {
content: "\e197";
}
.glyphicon-cloud-upload:before {
content: "\e198";
}
.glyphicon-tree-conifer:before {
content: "\e199";
}
.glyphicon-tree-deciduous:before {
content: "\e200";
}
.glyphicon-cd:before {
content: "\e201";
}
.glyphicon-save-file:before {
content: "\e202";
}
.glyphicon-open-file:before {
content: "\e203";
}
.glyphicon-level-up:before {
content: "\e204";
}
.glyphicon-copy:before {
content: "\e205";
}
.glyphicon-paste:before {
content: "\e206";
}
.glyphicon-alert:before {
content: "\e209";
}
.glyphicon-equalizer:before {
content: "\e210";
}
.glyphicon-king:before {
content: "\e211";
}
.glyphicon-queen:before {
content: "\e212";
}
.glyphicon-pawn:before {
content: "\e213";
}
.glyphicon-bishop:before {
content: "\e214";
}
.glyphicon-knight:before {
content: "\e215";
}
.glyphicon-baby-formula:before {
content: "\e216";
}
.glyphicon-tent:before {
content: "\26fa";
}
.glyphicon-blackboard:before {
content: "\e218";
}
.glyphicon-bed:before {
content: "\e219";
}
.glyphicon-apple:before {
content: "\f8ff";
}
.glyphicon-erase:before {
content: "\e221";
}
.glyphicon-hourglass:before {
content: "\231b";
}
.glyphicon-lamp:before {
content: "\e223";
}
.glyphicon-duplicate:before {
content: "\e224";
}
.glyphicon-piggy-bank:before {
content: "\e225";
}
.glyphicon-scissors:before {
content: "\e226";
}
.glyphicon-bitcoin:before {
content: "\e227";
}
.glyphicon-btc:before {
content: "\e227";
}
.glyphicon-xbt:before {
content: "\e227";
}
.glyphicon-yen:before {
content: "\00a5";
}
.glyphicon-jpy:before {
content: "\00a5";
}
.glyphicon-ruble:before {
content: "\20bd";
}
.glyphicon-rub:before {
content: "\20bd";
}
.glyphicon-scale:before {
content: "\e230";
}
.glyphicon-ice-lolly:before {
content: "\e231";
}
.glyphicon-ice-lolly-tasted:before {
content: "\e232";
}
.glyphicon-education:before {
content: "\e233";
}
.glyphicon-option-horizontal:before {
content: "\e234";
}
.glyphicon-option-vertical:before {
content: "\e235";
}
.glyphicon-menu-hamburger:before {
content: "\e236";
}
.glyphicon-modal-window:before {
content: "\e237";
}
.glyphicon-oil:before {
content: "\e238";
}
.glyphicon-grain:before {
content: "\e239";
}
.glyphicon-sunglasses:before {
content: "\e240";
}
.glyphicon-text-size:before {
content: "\e241";
}
.glyphicon-text-color:before {
content: "\e242";
}
.glyphicon-text-background:before {
content: "\e243";
}
.glyphicon-object-align-top:before {
content: "\e244";
}
.glyphicon-object-align-bottom:before {
content: "\e245";
}
.glyphicon-object-align-horizontal:before {
content: "\e246";
}
.glyphicon-object-align-left:before {
content: "\e247";
}
.glyphicon-object-align-vertical:before {
content: "\e248";
}
.glyphicon-object-align-right:before {
content: "\e249";
}
.glyphicon-triangle-right:before {
content: "\e250";
}
.glyphicon-triangle-left:before {
content: "\e251";
}
.glyphicon-triangle-bottom:before {
content: "\e252";
}
.glyphicon-triangle-top:before {
content: "\e253";
}
.glyphicon-console:before {
content: "\e254";
}
.glyphicon-superscript:before {
content: "\e255";
}
.glyphicon-subscript:before {
content: "\e256";
}
.glyphicon-menu-left:before {
content: "\e257";
}
.glyphicon-menu-right:before {
content: "\e258";
}
.glyphicon-menu-down:before {
content: "\e259";
}
.glyphicon-menu-up:before {
content: "\e260";
}
* {
-webkit-box-sizing: border-box;
-moz-box-sizing: border-box;
box-sizing: border-box;
}
*:before,
*:after {
-webkit-box-sizing: border-box;
-moz-box-sizing: border-box;
box-sizing: border-box;
}
html {
font-size: 10px;
-webkit-tap-highlight-color: rgba(0, 0, 0, 0);
}
body {
font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
font-size: 13px;
line-height: 1.42857143;
color: #000;
background-color: #fff;
}
input,
button,
select,
textarea {
font-family: inherit;
font-size: inherit;
line-height: inherit;
}
a {
color: #337ab7;
text-decoration: none;
}
a:hover,
a:focus {
color: #23527c;
text-decoration: underline;
}
a:focus {
outline: 5px auto -webkit-focus-ring-color;
outline-offset: -2px;
}
figure {
margin: 0;
}
img {
vertical-align: middle;
}
.img-responsive,
.thumbnail > img,
.thumbnail a > img,
.carousel-inner > .item > img,
.carousel-inner > .item > a > img {
display: block;
max-width: 100%;
height: auto;
}
.img-rounded {
border-radius: 3px;
}
.img-thumbnail {
padding: 4px;
line-height: 1.42857143;
background-color: #fff;
border: 1px solid #ddd;
border-radius: 2px;
-webkit-transition: all 0.2s ease-in-out;
-o-transition: all 0.2s ease-in-out;
transition: all 0.2s ease-in-out;
display: inline-block;
max-width: 100%;
height: auto;
}
.img-circle {
border-radius: 50%;
}
hr {
margin-top: 18px;
margin-bottom: 18px;
border: 0;
border-top: 1px solid #eeeeee;
}
.sr-only {
position: absolute;
width: 1px;
height: 1px;
margin: -1px;
padding: 0;
overflow: hidden;
clip: rect(0, 0, 0, 0);
border: 0;
}
.sr-only-focusable:active,
.sr-only-focusable:focus {
position: static;
width: auto;
height: auto;
margin: 0;
overflow: visible;
clip: auto;
}
[role="button"] {
cursor: pointer;
}
h1,
h2,
h3,
h4,
h5,
h6,
.h1,
.h2,
.h3,
.h4,
.h5,
.h6 {
font-family: inherit;
font-weight: 500;
line-height: 1.1;
color: inherit;
}
h1 small,
h2 small,
h3 small,
h4 small,
h5 small,
h6 small,
.h1 small,
.h2 small,
.h3 small,
.h4 small,
.h5 small,
.h6 small,
h1 .small,
h2 .small,
h3 .small,
h4 .small,
h5 .small,
h6 .small,
.h1 .small,
.h2 .small,
.h3 .small,
.h4 .small,
.h5 .small,
.h6 .small {
font-weight: normal;
line-height: 1;
color: #777777;
}
h1,
.h1,
h2,
.h2,
h3,
.h3 {
margin-top: 18px;
margin-bottom: 9px;
}
h1 small,
.h1 small,
h2 small,
.h2 small,
h3 small,
.h3 small,
h1 .small,
.h1 .small,
h2 .small,
.h2 .small,
h3 .small,
.h3 .small {
font-size: 65%;
}
h4,
.h4,
h5,
.h5,
h6,
.h6 {
margin-top: 9px;
margin-bottom: 9px;
}
h4 small,
.h4 small,
h5 small,
.h5 small,
h6 small,
.h6 small,
h4 .small,
.h4 .small,
h5 .small,
.h5 .small,
h6 .small,
.h6 .small {
font-size: 75%;
}
h1,
.h1 {
font-size: 33px;
}
h2,
.h2 {
font-size: 27px;
}
h3,
.h3 {
font-size: 23px;
}
h4,
.h4 {
font-size: 17px;
}
h5,
.h5 {
font-size: 13px;
}
h6,
.h6 {
font-size: 12px;
}
p {
margin: 0 0 9px;
}
.lead {
margin-bottom: 18px;
font-size: 14px;
font-weight: 300;
line-height: 1.4;
}
@media (min-width: 768px) {
.lead {
font-size: 19.5px;
}
}
small,
.small {
font-size: 92%;
}
mark,
.mark {
background-color: #fcf8e3;
padding: .2em;
}
.text-left {
text-align: left;
}
.text-right {
text-align: right;
}
.text-center {
text-align: center;
}
.text-justify {
text-align: justify;
}
.text-nowrap {
white-space: nowrap;
}
.text-lowercase {
text-transform: lowercase;
}
.text-uppercase {
text-transform: uppercase;
}
.text-capitalize {
text-transform: capitalize;
}
.text-muted {
color: #777777;
}
.text-primary {
color: #337ab7;
}
a.text-primary:hover,
a.text-primary:focus {
color: #286090;
}
.text-success {
color: #3c763d;
}
a.text-success:hover,
a.text-success:focus {
color: #2b542c;
}
.text-info {
color: #31708f;
}
a.text-info:hover,
a.text-info:focus {
color: #245269;
}
.text-warning {
color: #8a6d3b;
}
a.text-warning:hover,
a.text-warning:focus {
color: #66512c;
}
.text-danger {
color: #a94442;
}
a.text-danger:hover,
a.text-danger:focus {
color: #843534;
}
.bg-primary {
color: #fff;
background-color: #337ab7;
}
a.bg-primary:hover,
a.bg-primary:focus {
background-color: #286090;
}
.bg-success {
background-color: #dff0d8;
}
a.bg-success:hover,
a.bg-success:focus {
background-color: #c1e2b3;
}
.bg-info {
background-color: #d9edf7;
}
a.bg-info:hover,
a.bg-info:focus {
background-color: #afd9ee;
}
.bg-warning {
background-color: #fcf8e3;
}
a.bg-warning:hover,
a.bg-warning:focus {
background-color: #f7ecb5;
}
.bg-danger {
background-color: #f2dede;
}
a.bg-danger:hover,
a.bg-danger:focus {
background-color: #e4b9b9;
}
.page-header {
padding-bottom: 8px;
margin: 36px 0 18px;
border-bottom: 1px solid #eeeeee;
}
ul,
ol {
margin-top: 0;
margin-bottom: 9px;
}
ul ul,
ol ul,
ul ol,
ol ol {
margin-bottom: 0;
}
.list-unstyled {
padding-left: 0;
list-style: none;
}
.list-inline {
padding-left: 0;
list-style: none;
margin-left: -5px;
}
.list-inline > li {
display: inline-block;
padding-left: 5px;
padding-right: 5px;
}
dl {
margin-top: 0;
margin-bottom: 18px;
}
dt,
dd {
line-height: 1.42857143;
}
dt {
font-weight: bold;
}
dd {
margin-left: 0;
}
@media (min-width: 541px) {
.dl-horizontal dt {
float: left;
width: 160px;
clear: left;
text-align: right;
overflow: hidden;
text-overflow: ellipsis;
white-space: nowrap;
}
.dl-horizontal dd {
margin-left: 180px;
}
}
abbr[title],
abbr[data-original-title] {
cursor: help;
border-bottom: 1px dotted #777777;
}
.initialism {
font-size: 90%;
text-transform: uppercase;
}
blockquote {
padding: 9px 18px;
margin: 0 0 18px;
font-size: inherit;
border-left: 5px solid #eeeeee;
}
blockquote p:last-child,
blockquote ul:last-child,
blockquote ol:last-child {
margin-bottom: 0;
}
blockquote footer,
blockquote small,
blockquote .small {
display: block;
font-size: 80%;
line-height: 1.42857143;
color: #777777;
}
blockquote footer:before,
blockquote small:before,
blockquote .small:before {
content: '\2014 \00A0';
}
.blockquote-reverse,
blockquote.pull-right {
padding-right: 15px;
padding-left: 0;
border-right: 5px solid #eeeeee;
border-left: 0;
text-align: right;
}
.blockquote-reverse footer:before,
blockquote.pull-right footer:before,
.blockquote-reverse small:before,
blockquote.pull-right small:before,
.blockquote-reverse .small:before,
blockquote.pull-right .small:before {
content: '';
}
.blockquote-reverse footer:after,
blockquote.pull-right footer:after,
.blockquote-reverse small:after,
blockquote.pull-right small:after,
.blockquote-reverse .small:after,
blockquote.pull-right .small:after {
content: '\00A0 \2014';
}
address {
margin-bottom: 18px;
font-style: normal;
line-height: 1.42857143;
}
code,
kbd,
pre,
samp {
font-family: monospace;
}
code {
padding: 2px 4px;
font-size: 90%;
color: #c7254e;
background-color: #f9f2f4;
border-radius: 2px;
}
kbd {
padding: 2px 4px;
font-size: 90%;
color: #888;
background-color: transparent;
border-radius: 1px;
box-shadow: inset 0 -1px 0 rgba(0, 0, 0, 0.25);
}
kbd kbd {
padding: 0;
font-size: 100%;
font-weight: bold;
box-shadow: none;
}
pre {
display: block;
padding: 8.5px;
margin: 0 0 9px;
font-size: 12px;
line-height: 1.42857143;
word-break: break-all;
word-wrap: break-word;
color: #333333;
background-color: #f5f5f5;
border: 1px solid #ccc;
border-radius: 2px;
}
pre code {
padding: 0;
font-size: inherit;
color: inherit;
white-space: pre-wrap;
background-color: transparent;
border-radius: 0;
}
.pre-scrollable {
max-height: 340px;
overflow-y: scroll;
}
.container {
margin-right: auto;
margin-left: auto;
padding-left: 0px;
padding-right: 0px;
}
@media (min-width: 768px) {
.container {
width: 768px;
}
}
@media (min-width: 992px) {
.container {
width: 940px;
}
}
@media (min-width: 1200px) {
.container {
width: 1140px;
}
}
.container-fluid {
margin-right: auto;
margin-left: auto;
padding-left: 0px;
padding-right: 0px;
}
.row {
margin-left: 0px;
margin-right: 0px;
}
.col-xs-1, .col-sm-1, .col-md-1, .col-lg-1, .col-xs-2, .col-sm-2, .col-md-2, .col-lg-2, .col-xs-3, .col-sm-3, .col-md-3, .col-lg-3, .col-xs-4, .col-sm-4, .col-md-4, .col-lg-4, .col-xs-5, .col-sm-5, .col-md-5, .col-lg-5, .col-xs-6, .col-sm-6, .col-md-6, .col-lg-6, .col-xs-7, .col-sm-7, .col-md-7, .col-lg-7, .col-xs-8, .col-sm-8, .col-md-8, .col-lg-8, .col-xs-9, .col-sm-9, .col-md-9, .col-lg-9, .col-xs-10, .col-sm-10, .col-md-10, .col-lg-10, .col-xs-11, .col-sm-11, .col-md-11, .col-lg-11, .col-xs-12, .col-sm-12, .col-md-12, .col-lg-12 {
position: relative;
min-height: 1px;
padding-left: 0px;
padding-right: 0px;
}
.col-xs-1, .col-xs-2, .col-xs-3, .col-xs-4, .col-xs-5, .col-xs-6, .col-xs-7, .col-xs-8, .col-xs-9, .col-xs-10, .col-xs-11, .col-xs-12 {
float: left;
}
.col-xs-12 {
width: 100%;
}
.col-xs-11 {
width: 91.66666667%;
}
.col-xs-10 {
width: 83.33333333%;
}
.col-xs-9 {
width: 75%;
}
.col-xs-8 {
width: 66.66666667%;
}
.col-xs-7 {
width: 58.33333333%;
}
.col-xs-6 {
width: 50%;
}
.col-xs-5 {
width: 41.66666667%;
}
.col-xs-4 {
width: 33.33333333%;
}
.col-xs-3 {
width: 25%;
}
.col-xs-2 {
width: 16.66666667%;
}
.col-xs-1 {
width: 8.33333333%;
}
.col-xs-pull-12 {
right: 100%;
}
.col-xs-pull-11 {
right: 91.66666667%;
}
.col-xs-pull-10 {
right: 83.33333333%;
}
.col-xs-pull-9 {
right: 75%;
}
.col-xs-pull-8 {
right: 66.66666667%;
}
.col-xs-pull-7 {
right: 58.33333333%;
}
.col-xs-pull-6 {
right: 50%;
}
.col-xs-pull-5 {
right: 41.66666667%;
}
.col-xs-pull-4 {
right: 33.33333333%;
}
.col-xs-pull-3 {
right: 25%;
}
.col-xs-pull-2 {
right: 16.66666667%;
}
.col-xs-pull-1 {
right: 8.33333333%;
}
.col-xs-pull-0 {
right: auto;
}
.col-xs-push-12 {
left: 100%;
}
.col-xs-push-11 {
left: 91.66666667%;
}
.col-xs-push-10 {
left: 83.33333333%;
}
.col-xs-push-9 {
left: 75%;
}
.col-xs-push-8 {
left: 66.66666667%;
}
.col-xs-push-7 {
left: 58.33333333%;
}
.col-xs-push-6 {
left: 50%;
}
.col-xs-push-5 {
left: 41.66666667%;
}
.col-xs-push-4 {
left: 33.33333333%;
}
.col-xs-push-3 {
left: 25%;
}
.col-xs-push-2 {
left: 16.66666667%;
}
.col-xs-push-1 {
left: 8.33333333%;
}
.col-xs-push-0 {
left: auto;
}
.col-xs-offset-12 {
margin-left: 100%;
}
.col-xs-offset-11 {
margin-left: 91.66666667%;
}
.col-xs-offset-10 {
margin-left: 83.33333333%;
}
.col-xs-offset-9 {
margin-left: 75%;
}
.col-xs-offset-8 {
margin-left: 66.66666667%;
}
.col-xs-offset-7 {
margin-left: 58.33333333%;
}
.col-xs-offset-6 {
margin-left: 50%;
}
.col-xs-offset-5 {
margin-left: 41.66666667%;
}
.col-xs-offset-4 {
margin-left: 33.33333333%;
}
.col-xs-offset-3 {
margin-left: 25%;
}
.col-xs-offset-2 {
margin-left: 16.66666667%;
}
.col-xs-offset-1 {
margin-left: 8.33333333%;
}
.col-xs-offset-0 {
margin-left: 0%;
}
@media (min-width: 768px) {
.col-sm-1, .col-sm-2, .col-sm-3, .col-sm-4, .col-sm-5, .col-sm-6, .col-sm-7, .col-sm-8, .col-sm-9, .col-sm-10, .col-sm-11, .col-sm-12 {
float: left;
}
.col-sm-12 {
width: 100%;
}
.col-sm-11 {
width: 91.66666667%;
}
.col-sm-10 {
width: 83.33333333%;
}
.col-sm-9 {
width: 75%;
}
.col-sm-8 {
width: 66.66666667%;
}
.col-sm-7 {
width: 58.33333333%;
}
.col-sm-6 {
width: 50%;
}
.col-sm-5 {
width: 41.66666667%;
}
.col-sm-4 {
width: 33.33333333%;
}
.col-sm-3 {
width: 25%;
}
.col-sm-2 {
width: 16.66666667%;
}
.col-sm-1 {
width: 8.33333333%;
}
.col-sm-pull-12 {
right: 100%;
}
.col-sm-pull-11 {
right: 91.66666667%;
}
.col-sm-pull-10 {
right: 83.33333333%;
}
.col-sm-pull-9 {
right: 75%;
}
.col-sm-pull-8 {
right: 66.66666667%;
}
.col-sm-pull-7 {
right: 58.33333333%;
}
.col-sm-pull-6 {
right: 50%;
}
.col-sm-pull-5 {
right: 41.66666667%;
}
.col-sm-pull-4 {
right: 33.33333333%;
}
.col-sm-pull-3 {
right: 25%;
}
.col-sm-pull-2 {
right: 16.66666667%;
}
.col-sm-pull-1 {
right: 8.33333333%;
}
.col-sm-pull-0 {
right: auto;
}
.col-sm-push-12 {
left: 100%;
}
.col-sm-push-11 {
left: 91.66666667%;
}
.col-sm-push-10 {
left: 83.33333333%;
}
.col-sm-push-9 {
left: 75%;
}
.col-sm-push-8 {
left: 66.66666667%;
}
.col-sm-push-7 {
left: 58.33333333%;
}
.col-sm-push-6 {
left: 50%;
}
.col-sm-push-5 {
left: 41.66666667%;
}
.col-sm-push-4 {
left: 33.33333333%;
}
.col-sm-push-3 {
left: 25%;
}
.col-sm-push-2 {
left: 16.66666667%;
}
.col-sm-push-1 {
left: 8.33333333%;
}
.col-sm-push-0 {
left: auto;
}
.col-sm-offset-12 {
margin-left: 100%;
}
.col-sm-offset-11 {
margin-left: 91.66666667%;
}
.col-sm-offset-10 {
margin-left: 83.33333333%;
}
.col-sm-offset-9 {
margin-left: 75%;
}
.col-sm-offset-8 {
margin-left: 66.66666667%;
}
.col-sm-offset-7 {
margin-left: 58.33333333%;
}
.col-sm-offset-6 {
margin-left: 50%;
}
.col-sm-offset-5 {
margin-left: 41.66666667%;
}
.col-sm-offset-4 {
margin-left: 33.33333333%;
}
.col-sm-offset-3 {
margin-left: 25%;
}
.col-sm-offset-2 {
margin-left: 16.66666667%;
}
.col-sm-offset-1 {
margin-left: 8.33333333%;
}
.col-sm-offset-0 {
margin-left: 0%;
}
}
@media (min-width: 992px) {
.col-md-1, .col-md-2, .col-md-3, .col-md-4, .col-md-5, .col-md-6, .col-md-7, .col-md-8, .col-md-9, .col-md-10, .col-md-11, .col-md-12 {
float: left;
}
.col-md-12 {
width: 100%;
}
.col-md-11 {
width: 91.66666667%;
}
.col-md-10 {
width: 83.33333333%;
}
.col-md-9 {
width: 75%;
}
.col-md-8 {
width: 66.66666667%;
}
.col-md-7 {
width: 58.33333333%;
}
.col-md-6 {
width: 50%;
}
.col-md-5 {
width: 41.66666667%;
}
.col-md-4 {
width: 33.33333333%;
}
.col-md-3 {
width: 25%;
}
.col-md-2 {
width: 16.66666667%;
}
.col-md-1 {
width: 8.33333333%;
}
.col-md-pull-12 {
right: 100%;
}
.col-md-pull-11 {
right: 91.66666667%;
}
.col-md-pull-10 {
right: 83.33333333%;
}
.col-md-pull-9 {
right: 75%;
}
.col-md-pull-8 {
right: 66.66666667%;
}
.col-md-pull-7 {
right: 58.33333333%;
}
.col-md-pull-6 {
right: 50%;
}
.col-md-pull-5 {
right: 41.66666667%;
}
.col-md-pull-4 {
right: 33.33333333%;
}
.col-md-pull-3 {
right: 25%;
}
.col-md-pull-2 {
right: 16.66666667%;
}
.col-md-pull-1 {
right: 8.33333333%;
}
.col-md-pull-0 {
right: auto;
}
.col-md-push-12 {
left: 100%;
}
.col-md-push-11 {
left: 91.66666667%;
}
.col-md-push-10 {
left: 83.33333333%;
}
.col-md-push-9 {
left: 75%;
}
.col-md-push-8 {
left: 66.66666667%;
}
.col-md-push-7 {
left: 58.33333333%;
}
.col-md-push-6 {
left: 50%;
}
.col-md-push-5 {
left: 41.66666667%;
}
.col-md-push-4 {
left: 33.33333333%;
}
.col-md-push-3 {
left: 25%;
}
.col-md-push-2 {
left: 16.66666667%;
}
.col-md-push-1 {
left: 8.33333333%;
}
.col-md-push-0 {
left: auto;
}
.col-md-offset-12 {
margin-left: 100%;
}
.col-md-offset-11 {
margin-left: 91.66666667%;
}
.col-md-offset-10 {
margin-left: 83.33333333%;
}
.col-md-offset-9 {
margin-left: 75%;
}
.col-md-offset-8 {
margin-left: 66.66666667%;
}
.col-md-offset-7 {
margin-left: 58.33333333%;
}
.col-md-offset-6 {
margin-left: 50%;
}
.col-md-offset-5 {
margin-left: 41.66666667%;
}
.col-md-offset-4 {
margin-left: 33.33333333%;
}
.col-md-offset-3 {
margin-left: 25%;
}
.col-md-offset-2 {
margin-left: 16.66666667%;
}
.col-md-offset-1 {
margin-left: 8.33333333%;
}
.col-md-offset-0 {
margin-left: 0%;
}
}
@media (min-width: 1200px) {
.col-lg-1, .col-lg-2, .col-lg-3, .col-lg-4, .col-lg-5, .col-lg-6, .col-lg-7, .col-lg-8, .col-lg-9, .col-lg-10, .col-lg-11, .col-lg-12 {
float: left;
}
.col-lg-12 {
width: 100%;
}
.col-lg-11 {
width: 91.66666667%;
}
.col-lg-10 {
width: 83.33333333%;
}
.col-lg-9 {
width: 75%;
}
.col-lg-8 {
width: 66.66666667%;
}
.col-lg-7 {
width: 58.33333333%;
}
.col-lg-6 {
width: 50%;
}
.col-lg-5 {
width: 41.66666667%;
}
.col-lg-4 {
width: 33.33333333%;
}
.col-lg-3 {
width: 25%;
}
.col-lg-2 {
width: 16.66666667%;
}
.col-lg-1 {
width: 8.33333333%;
}
.col-lg-pull-12 {
right: 100%;
}
.col-lg-pull-11 {
right: 91.66666667%;
}
.col-lg-pull-10 {
right: 83.33333333%;
}
.col-lg-pull-9 {
right: 75%;
}
.col-lg-pull-8 {
right: 66.66666667%;
}
.col-lg-pull-7 {
right: 58.33333333%;
}
.col-lg-pull-6 {
right: 50%;
}
.col-lg-pull-5 {
right: 41.66666667%;
}
.col-lg-pull-4 {
right: 33.33333333%;
}
.col-lg-pull-3 {
right: 25%;
}
.col-lg-pull-2 {
right: 16.66666667%;
}
.col-lg-pull-1 {
right: 8.33333333%;
}
.col-lg-pull-0 {
right: auto;
}
.col-lg-push-12 {
left: 100%;
}
.col-lg-push-11 {
left: 91.66666667%;
}
.col-lg-push-10 {
left: 83.33333333%;
}
.col-lg-push-9 {
left: 75%;
}
.col-lg-push-8 {
left: 66.66666667%;
}
.col-lg-push-7 {
left: 58.33333333%;
}
.col-lg-push-6 {
left: 50%;
}
.col-lg-push-5 {
left: 41.66666667%;
}
.col-lg-push-4 {
left: 33.33333333%;
}
.col-lg-push-3 {
left: 25%;
}
.col-lg-push-2 {
left: 16.66666667%;
}
.col-lg-push-1 {
left: 8.33333333%;
}
.col-lg-push-0 {
left: auto;
}
.col-lg-offset-12 {
margin-left: 100%;
}
.col-lg-offset-11 {
margin-left: 91.66666667%;
}
.col-lg-offset-10 {
margin-left: 83.33333333%;
}
.col-lg-offset-9 {
margin-left: 75%;
}
.col-lg-offset-8 {
margin-left: 66.66666667%;
}
.col-lg-offset-7 {
margin-left: 58.33333333%;
}
.col-lg-offset-6 {
margin-left: 50%;
}
.col-lg-offset-5 {
margin-left: 41.66666667%;
}
.col-lg-offset-4 {
margin-left: 33.33333333%;
}
.col-lg-offset-3 {
margin-left: 25%;
}
.col-lg-offset-2 {
margin-left: 16.66666667%;
}
.col-lg-offset-1 {
margin-left: 8.33333333%;
}
.col-lg-offset-0 {
margin-left: 0%;
}
}
table {
background-color: transparent;
}
caption {
padding-top: 8px;
padding-bottom: 8px;
color: #777777;
text-align: left;
}
th {
text-align: left;
}
.table {
width: 100%;
max-width: 100%;
margin-bottom: 18px;
}
.table > thead > tr > th,
.table > tbody > tr > th,
.table > tfoot > tr > th,
.table > thead > tr > td,
.table > tbody > tr > td,
.table > tfoot > tr > td {
padding: 8px;
line-height: 1.42857143;
vertical-align: top;
border-top: 1px solid #ddd;
}
.table > thead > tr > th {
vertical-align: bottom;
border-bottom: 2px solid #ddd;
}
.table > caption + thead > tr:first-child > th,
.table > colgroup + thead > tr:first-child > th,
.table > thead:first-child > tr:first-child > th,
.table > caption + thead > tr:first-child > td,
.table > colgroup + thead > tr:first-child > td,
.table > thead:first-child > tr:first-child > td {
border-top: 0;
}
.table > tbody + tbody {
border-top: 2px solid #ddd;
}
.table .table {
background-color: #fff;
}
.table-condensed > thead > tr > th,
.table-condensed > tbody > tr > th,
.table-condensed > tfoot > tr > th,
.table-condensed > thead > tr > td,
.table-condensed > tbody > tr > td,
.table-condensed > tfoot > tr > td {
padding: 5px;
}
.table-bordered {
border: 1px solid #ddd;
}
.table-bordered > thead > tr > th,
.table-bordered > tbody > tr > th,
.table-bordered > tfoot > tr > th,
.table-bordered > thead > tr > td,
.table-bordered > tbody > tr > td,
.table-bordered > tfoot > tr > td {
border: 1px solid #ddd;
}
.table-bordered > thead > tr > th,
.table-bordered > thead > tr > td {
border-bottom-width: 2px;
}
.table-striped > tbody > tr:nth-of-type(odd) {
background-color: #f9f9f9;
}
.table-hover > tbody > tr:hover {
background-color: #f5f5f5;
}
table col[class*="col-"] {
position: static;
float: none;
display: table-column;
}
table td[class*="col-"],
table th[class*="col-"] {
position: static;
float: none;
display: table-cell;
}
.table > thead > tr > td.active,
.table > tbody > tr > td.active,
.table > tfoot > tr > td.active,
.table > thead > tr > th.active,
.table > tbody > tr > th.active,
.table > tfoot > tr > th.active,
.table > thead > tr.active > td,
.table > tbody > tr.active > td,
.table > tfoot > tr.active > td,
.table > thead > tr.active > th,
.table > tbody > tr.active > th,
.table > tfoot > tr.active > th {
background-color: #f5f5f5;
}
.table-hover > tbody > tr > td.active:hover,
.table-hover > tbody > tr > th.active:hover,
.table-hover > tbody > tr.active:hover > td,
.table-hover > tbody > tr:hover > .active,
.table-hover > tbody > tr.active:hover > th {
background-color: #e8e8e8;
}
.table > thead > tr > td.success,
.table > tbody > tr > td.success,
.table > tfoot > tr > td.success,
.table > thead > tr > th.success,
.table > tbody > tr > th.success,
.table > tfoot > tr > th.success,
.table > thead > tr.success > td,
.table > tbody > tr.success > td,
.table > tfoot > tr.success > td,
.table > thead > tr.success > th,
.table > tbody > tr.success > th,
.table > tfoot > tr.success > th {
background-color: #dff0d8;
}
.table-hover > tbody > tr > td.success:hover,
.table-hover > tbody > tr > th.success:hover,
.table-hover > tbody > tr.success:hover > td,
.table-hover > tbody > tr:hover > .success,
.table-hover > tbody > tr.success:hover > th {
background-color: #d0e9c6;
}
.table > thead > tr > td.info,
.table > tbody > tr > td.info,
.table > tfoot > tr > td.info,
.table > thead > tr > th.info,
.table > tbody > tr > th.info,
.table > tfoot > tr > th.info,
.table > thead > tr.info > td,
.table > tbody > tr.info > td,
.table > tfoot > tr.info > td,
.table > thead > tr.info > th,
.table > tbody > tr.info > th,
.table > tfoot > tr.info > th {
background-color: #d9edf7;
}
.table-hover > tbody > tr > td.info:hover,
.table-hover > tbody > tr > th.info:hover,
.table-hover > tbody > tr.info:hover > td,
.table-hover > tbody > tr:hover > .info,
.table-hover > tbody > tr.info:hover > th {
background-color: #c4e3f3;
}
.table > thead > tr > td.warning,
.table > tbody > tr > td.warning,
.table > tfoot > tr > td.warning,
.table > thead > tr > th.warning,
.table > tbody > tr > th.warning,
.table > tfoot > tr > th.warning,
.table > thead > tr.warning > td,
.table > tbody > tr.warning > td,
.table > tfoot > tr.warning > td,
.table > thead > tr.warning > th,
.table > tbody > tr.warning > th,
.table > tfoot > tr.warning > th {
background-color: #fcf8e3;
}
.table-hover > tbody > tr > td.warning:hover,
.table-hover > tbody > tr > th.warning:hover,
.table-hover > tbody > tr.warning:hover > td,
.table-hover > tbody > tr:hover > .warning,
.table-hover > tbody > tr.warning:hover > th {
background-color: #faf2cc;
}
.table > thead > tr > td.danger,
.table > tbody > tr > td.danger,
.table > tfoot > tr > td.danger,
.table > thead > tr > th.danger,
.table > tbody > tr > th.danger,
.table > tfoot > tr > th.danger,
.table > thead > tr.danger > td,
.table > tbody > tr.danger > td,
.table > tfoot > tr.danger > td,
.table > thead > tr.danger > th,
.table > tbody > tr.danger > th,
.table > tfoot > tr.danger > th {
background-color: #f2dede;
}
.table-hover > tbody > tr > td.danger:hover,
.table-hover > tbody > tr > th.danger:hover,
.table-hover > tbody > tr.danger:hover > td,
.table-hover > tbody > tr:hover > .danger,
.table-hover > tbody > tr.danger:hover > th {
background-color: #ebcccc;
}
.table-responsive {
overflow-x: auto;
min-height: 0.01%;
}
@media screen and (max-width: 767px) {
.table-responsive {
width: 100%;
margin-bottom: 13.5px;
overflow-y: hidden;
-ms-overflow-style: -ms-autohiding-scrollbar;
border: 1px solid #ddd;
}
.table-responsive > .table {
margin-bottom: 0;
}
.table-responsive > .table > thead > tr > th,
.table-responsive > .table > tbody > tr > th,
.table-responsive > .table > tfoot > tr > th,
.table-responsive > .table > thead > tr > td,
.table-responsive > .table > tbody > tr > td,
.table-responsive > .table > tfoot > tr > td {
white-space: nowrap;
}
.table-responsive > .table-bordered {
border: 0;
}
.table-responsive > .table-bordered > thead > tr > th:first-child,
.table-responsive > .table-bordered > tbody > tr > th:first-child,
.table-responsive > .table-bordered > tfoot > tr > th:first-child,
.table-responsive > .table-bordered > thead > tr > td:first-child,
.table-responsive > .table-bordered > tbody > tr > td:first-child,
.table-responsive > .table-bordered > tfoot > tr > td:first-child {
border-left: 0;
}
.table-responsive > .table-bordered > thead > tr > th:last-child,
.table-responsive > .table-bordered > tbody > tr > th:last-child,
.table-responsive > .table-bordered > tfoot > tr > th:last-child,
.table-responsive > .table-bordered > thead > tr > td:last-child,
.table-responsive > .table-bordered > tbody > tr > td:last-child,
.table-responsive > .table-bordered > tfoot > tr > td:last-child {
border-right: 0;
}
.table-responsive > .table-bordered > tbody > tr:last-child > th,
.table-responsive > .table-bordered > tfoot > tr:last-child > th,
.table-responsive > .table-bordered > tbody > tr:last-child > td,
.table-responsive > .table-bordered > tfoot > tr:last-child > td {
border-bottom: 0;
}
}
fieldset {
padding: 0;
margin: 0;
border: 0;
min-width: 0;
}
legend {
display: block;
width: 100%;
padding: 0;
margin-bottom: 18px;
font-size: 19.5px;
line-height: inherit;
color: #333333;
border: 0;
border-bottom: 1px solid #e5e5e5;
}
label {
display: inline-block;
max-width: 100%;
margin-bottom: 5px;
font-weight: bold;
}
input[type="search"] {
-webkit-box-sizing: border-box;
-moz-box-sizing: border-box;
box-sizing: border-box;
}
input[type="radio"],
input[type="checkbox"] {
margin: 4px 0 0;
margin-top: 1px \9;
line-height: normal;
}
input[type="file"] {
display: block;
}
input[type="range"] {
display: block;
width: 100%;
}
select[multiple],
select[size] {
height: auto;
}
input[type="file"]:focus,
input[type="radio"]:focus,
input[type="checkbox"]:focus {
outline: 5px auto -webkit-focus-ring-color;
outline-offset: -2px;
}
output {
display: block;
padding-top: 7px;
font-size: 13px;
line-height: 1.42857143;
color: #555555;
}
.form-control {
display: block;
width: 100%;
height: 32px;
padding: 6px 12px;
font-size: 13px;
line-height: 1.42857143;
color: #555555;
background-color: #fff;
background-image: none;
border: 1px solid #ccc;
border-radius: 2px;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
-webkit-transition: border-color ease-in-out .15s, box-shadow ease-in-out .15s;
-o-transition: border-color ease-in-out .15s, box-shadow ease-in-out .15s;
transition: border-color ease-in-out .15s, box-shadow ease-in-out .15s;
}
.form-control:focus {
border-color: #66afe9;
outline: 0;
-webkit-box-shadow: inset 0 1px 1px rgba(0,0,0,.075), 0 0 8px rgba(102, 175, 233, 0.6);
box-shadow: inset 0 1px 1px rgba(0,0,0,.075), 0 0 8px rgba(102, 175, 233, 0.6);
}
.form-control::-moz-placeholder {
color: #999;
opacity: 1;
}
.form-control:-ms-input-placeholder {
color: #999;
}
.form-control::-webkit-input-placeholder {
color: #999;
}
.form-control::-ms-expand {
border: 0;
background-color: transparent;
}
.form-control[disabled],
.form-control[readonly],
fieldset[disabled] .form-control {
background-color: #eeeeee;
opacity: 1;
}
.form-control[disabled],
fieldset[disabled] .form-control {
cursor: not-allowed;
}
textarea.form-control {
height: auto;
}
input[type="search"] {
-webkit-appearance: none;
}
@media screen and (-webkit-min-device-pixel-ratio: 0) {
input[type="date"].form-control,
input[type="time"].form-control,
input[type="datetime-local"].form-control,
input[type="month"].form-control {
line-height: 32px;
}
input[type="date"].input-sm,
input[type="time"].input-sm,
input[type="datetime-local"].input-sm,
input[type="month"].input-sm,
.input-group-sm input[type="date"],
.input-group-sm input[type="time"],
.input-group-sm input[type="datetime-local"],
.input-group-sm input[type="month"] {
line-height: 30px;
}
input[type="date"].input-lg,
input[type="time"].input-lg,
input[type="datetime-local"].input-lg,
input[type="month"].input-lg,
.input-group-lg input[type="date"],
.input-group-lg input[type="time"],
.input-group-lg input[type="datetime-local"],
.input-group-lg input[type="month"] {
line-height: 45px;
}
}
.form-group {
margin-bottom: 15px;
}
.radio,
.checkbox {
position: relative;
display: block;
margin-top: 10px;
margin-bottom: 10px;
}
.radio label,
.checkbox label {
min-height: 18px;
padding-left: 20px;
margin-bottom: 0;
font-weight: normal;
cursor: pointer;
}
.radio input[type="radio"],
.radio-inline input[type="radio"],
.checkbox input[type="checkbox"],
.checkbox-inline input[type="checkbox"] {
position: absolute;
margin-left: -20px;
margin-top: 4px \9;
}
.radio + .radio,
.checkbox + .checkbox {
margin-top: -5px;
}
.radio-inline,
.checkbox-inline {
position: relative;
display: inline-block;
padding-left: 20px;
margin-bottom: 0;
vertical-align: middle;
font-weight: normal;
cursor: pointer;
}
.radio-inline + .radio-inline,
.checkbox-inline + .checkbox-inline {
margin-top: 0;
margin-left: 10px;
}
input[type="radio"][disabled],
input[type="checkbox"][disabled],
input[type="radio"].disabled,
input[type="checkbox"].disabled,
fieldset[disabled] input[type="radio"],
fieldset[disabled] input[type="checkbox"] {
cursor: not-allowed;
}
.radio-inline.disabled,
.checkbox-inline.disabled,
fieldset[disabled] .radio-inline,
fieldset[disabled] .checkbox-inline {
cursor: not-allowed;
}
.radio.disabled label,
.checkbox.disabled label,
fieldset[disabled] .radio label,
fieldset[disabled] .checkbox label {
cursor: not-allowed;
}
.form-control-static {
padding-top: 7px;
padding-bottom: 7px;
margin-bottom: 0;
min-height: 31px;
}
.form-control-static.input-lg,
.form-control-static.input-sm {
padding-left: 0;
padding-right: 0;
}
.input-sm {
height: 30px;
padding: 5px 10px;
font-size: 12px;
line-height: 1.5;
border-radius: 1px;
}
select.input-sm {
height: 30px;
line-height: 30px;
}
textarea.input-sm,
select[multiple].input-sm {
height: auto;
}
.form-group-sm .form-control {
height: 30px;
padding: 5px 10px;
font-size: 12px;
line-height: 1.5;
border-radius: 1px;
}
.form-group-sm select.form-control {
height: 30px;
line-height: 30px;
}
.form-group-sm textarea.form-control,
.form-group-sm select[multiple].form-control {
height: auto;
}
.form-group-sm .form-control-static {
height: 30px;
min-height: 30px;
padding: 6px 10px;
font-size: 12px;
line-height: 1.5;
}
.input-lg {
height: 45px;
padding: 10px 16px;
font-size: 17px;
line-height: 1.3333333;
border-radius: 3px;
}
select.input-lg {
height: 45px;
line-height: 45px;
}
textarea.input-lg,
select[multiple].input-lg {
height: auto;
}
.form-group-lg .form-control {
height: 45px;
padding: 10px 16px;
font-size: 17px;
line-height: 1.3333333;
border-radius: 3px;
}
.form-group-lg select.form-control {
height: 45px;
line-height: 45px;
}
.form-group-lg textarea.form-control,
.form-group-lg select[multiple].form-control {
height: auto;
}
.form-group-lg .form-control-static {
height: 45px;
min-height: 35px;
padding: 11px 16px;
font-size: 17px;
line-height: 1.3333333;
}
.has-feedback {
position: relative;
}
.has-feedback .form-control {
padding-right: 40px;
}
.form-control-feedback {
position: absolute;
top: 0;
right: 0;
z-index: 2;
display: block;
width: 32px;
height: 32px;
line-height: 32px;
text-align: center;
pointer-events: none;
}
.input-lg + .form-control-feedback,
.input-group-lg + .form-control-feedback,
.form-group-lg .form-control + .form-control-feedback {
width: 45px;
height: 45px;
line-height: 45px;
}
.input-sm + .form-control-feedback,
.input-group-sm + .form-control-feedback,
.form-group-sm .form-control + .form-control-feedback {
width: 30px;
height: 30px;
line-height: 30px;
}
.has-success .help-block,
.has-success .control-label,
.has-success .radio,
.has-success .checkbox,
.has-success .radio-inline,
.has-success .checkbox-inline,
.has-success.radio label,
.has-success.checkbox label,
.has-success.radio-inline label,
.has-success.checkbox-inline label {
color: #3c763d;
}
.has-success .form-control {
border-color: #3c763d;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
}
.has-success .form-control:focus {
border-color: #2b542c;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075), 0 0 6px #67b168;
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075), 0 0 6px #67b168;
}
.has-success .input-group-addon {
color: #3c763d;
border-color: #3c763d;
background-color: #dff0d8;
}
.has-success .form-control-feedback {
color: #3c763d;
}
.has-warning .help-block,
.has-warning .control-label,
.has-warning .radio,
.has-warning .checkbox,
.has-warning .radio-inline,
.has-warning .checkbox-inline,
.has-warning.radio label,
.has-warning.checkbox label,
.has-warning.radio-inline label,
.has-warning.checkbox-inline label {
color: #8a6d3b;
}
.has-warning .form-control {
border-color: #8a6d3b;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
}
.has-warning .form-control:focus {
border-color: #66512c;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075), 0 0 6px #c0a16b;
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075), 0 0 6px #c0a16b;
}
.has-warning .input-group-addon {
color: #8a6d3b;
border-color: #8a6d3b;
background-color: #fcf8e3;
}
.has-warning .form-control-feedback {
color: #8a6d3b;
}
.has-error .help-block,
.has-error .control-label,
.has-error .radio,
.has-error .checkbox,
.has-error .radio-inline,
.has-error .checkbox-inline,
.has-error.radio label,
.has-error.checkbox label,
.has-error.radio-inline label,
.has-error.checkbox-inline label {
color: #a94442;
}
.has-error .form-control {
border-color: #a94442;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
}
.has-error .form-control:focus {
border-color: #843534;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075), 0 0 6px #ce8483;
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075), 0 0 6px #ce8483;
}
.has-error .input-group-addon {
color: #a94442;
border-color: #a94442;
background-color: #f2dede;
}
.has-error .form-control-feedback {
color: #a94442;
}
.has-feedback label ~ .form-control-feedback {
top: 23px;
}
.has-feedback label.sr-only ~ .form-control-feedback {
top: 0;
}
.help-block {
display: block;
margin-top: 5px;
margin-bottom: 10px;
color: #404040;
}
@media (min-width: 768px) {
.form-inline .form-group {
display: inline-block;
margin-bottom: 0;
vertical-align: middle;
}
.form-inline .form-control {
display: inline-block;
width: auto;
vertical-align: middle;
}
.form-inline .form-control-static {
display: inline-block;
}
.form-inline .input-group {
display: inline-table;
vertical-align: middle;
}
.form-inline .input-group .input-group-addon,
.form-inline .input-group .input-group-btn,
.form-inline .input-group .form-control {
width: auto;
}
.form-inline .input-group > .form-control {
width: 100%;
}
.form-inline .control-label {
margin-bottom: 0;
vertical-align: middle;
}
.form-inline .radio,
.form-inline .checkbox {
display: inline-block;
margin-top: 0;
margin-bottom: 0;
vertical-align: middle;
}
.form-inline .radio label,
.form-inline .checkbox label {
padding-left: 0;
}
.form-inline .radio input[type="radio"],
.form-inline .checkbox input[type="checkbox"] {
position: relative;
margin-left: 0;
}
.form-inline .has-feedback .form-control-feedback {
top: 0;
}
}
.form-horizontal .radio,
.form-horizontal .checkbox,
.form-horizontal .radio-inline,
.form-horizontal .checkbox-inline {
margin-top: 0;
margin-bottom: 0;
padding-top: 7px;
}
.form-horizontal .radio,
.form-horizontal .checkbox {
min-height: 25px;
}
.form-horizontal .form-group {
margin-left: 0px;
margin-right: 0px;
}
@media (min-width: 768px) {
.form-horizontal .control-label {
text-align: right;
margin-bottom: 0;
padding-top: 7px;
}
}
.form-horizontal .has-feedback .form-control-feedback {
right: 0px;
}
@media (min-width: 768px) {
.form-horizontal .form-group-lg .control-label {
padding-top: 11px;
font-size: 17px;
}
}
@media (min-width: 768px) {
.form-horizontal .form-group-sm .control-label {
padding-top: 6px;
font-size: 12px;
}
}
.btn {
display: inline-block;
margin-bottom: 0;
font-weight: normal;
text-align: center;
vertical-align: middle;
touch-action: manipulation;
cursor: pointer;
background-image: none;
border: 1px solid transparent;
white-space: nowrap;
padding: 6px 12px;
font-size: 13px;
line-height: 1.42857143;
border-radius: 2px;
-webkit-user-select: none;
-moz-user-select: none;
-ms-user-select: none;
user-select: none;
}
.btn:focus,
.btn:active:focus,
.btn.active:focus,
.btn.focus,
.btn:active.focus,
.btn.active.focus {
outline: 5px auto -webkit-focus-ring-color;
outline-offset: -2px;
}
.btn:hover,
.btn:focus,
.btn.focus {
color: #333;
text-decoration: none;
}
.btn:active,
.btn.active {
outline: 0;
background-image: none;
-webkit-box-shadow: inset 0 3px 5px rgba(0, 0, 0, 0.125);
box-shadow: inset 0 3px 5px rgba(0, 0, 0, 0.125);
}
.btn.disabled,
.btn[disabled],
fieldset[disabled] .btn {
cursor: not-allowed;
opacity: 0.65;
filter: alpha(opacity=65);
-webkit-box-shadow: none;
box-shadow: none;
}
a.btn.disabled,
fieldset[disabled] a.btn {
pointer-events: none;
}
.btn-default {
color: #333;
background-color: #fff;
border-color: #ccc;
}
.btn-default:focus,
.btn-default.focus {
color: #333;
background-color: #e6e6e6;
border-color: #8c8c8c;
}
.btn-default:hover {
color: #333;
background-color: #e6e6e6;
border-color: #adadad;
}
.btn-default:active,
.btn-default.active,
.open > .dropdown-toggle.btn-default {
color: #333;
background-color: #e6e6e6;
border-color: #adadad;
}
.btn-default:active:hover,
.btn-default.active:hover,
.open > .dropdown-toggle.btn-default:hover,
.btn-default:active:focus,
.btn-default.active:focus,
.open > .dropdown-toggle.btn-default:focus,
.btn-default:active.focus,
.btn-default.active.focus,
.open > .dropdown-toggle.btn-default.focus {
color: #333;
background-color: #d4d4d4;
border-color: #8c8c8c;
}
.btn-default:active,
.btn-default.active,
.open > .dropdown-toggle.btn-default {
background-image: none;
}
.btn-default.disabled:hover,
.btn-default[disabled]:hover,
fieldset[disabled] .btn-default:hover,
.btn-default.disabled:focus,
.btn-default[disabled]:focus,
fieldset[disabled] .btn-default:focus,
.btn-default.disabled.focus,
.btn-default[disabled].focus,
fieldset[disabled] .btn-default.focus {
background-color: #fff;
border-color: #ccc;
}
.btn-default .badge {
color: #fff;
background-color: #333;
}
.btn-primary {
color: #fff;
background-color: #337ab7;
border-color: #2e6da4;
}
.btn-primary:focus,
.btn-primary.focus {
color: #fff;
background-color: #286090;
border-color: #122b40;
}
.btn-primary:hover {
color: #fff;
background-color: #286090;
border-color: #204d74;
}
.btn-primary:active,
.btn-primary.active,
.open > .dropdown-toggle.btn-primary {
color: #fff;
background-color: #286090;
border-color: #204d74;
}
.btn-primary:active:hover,
.btn-primary.active:hover,
.open > .dropdown-toggle.btn-primary:hover,
.btn-primary:active:focus,
.btn-primary.active:focus,
.open > .dropdown-toggle.btn-primary:focus,
.btn-primary:active.focus,
.btn-primary.active.focus,
.open > .dropdown-toggle.btn-primary.focus {
color: #fff;
background-color: #204d74;
border-color: #122b40;
}
.btn-primary:active,
.btn-primary.active,
.open > .dropdown-toggle.btn-primary {
background-image: none;
}
.btn-primary.disabled:hover,
.btn-primary[disabled]:hover,
fieldset[disabled] .btn-primary:hover,
.btn-primary.disabled:focus,
.btn-primary[disabled]:focus,
fieldset[disabled] .btn-primary:focus,
.btn-primary.disabled.focus,
.btn-primary[disabled].focus,
fieldset[disabled] .btn-primary.focus {
background-color: #337ab7;
border-color: #2e6da4;
}
.btn-primary .badge {
color: #337ab7;
background-color: #fff;
}
.btn-success {
color: #fff;
background-color: #5cb85c;
border-color: #4cae4c;
}
.btn-success:focus,
.btn-success.focus {
color: #fff;
background-color: #449d44;
border-color: #255625;
}
.btn-success:hover {
color: #fff;
background-color: #449d44;
border-color: #398439;
}
.btn-success:active,
.btn-success.active,
.open > .dropdown-toggle.btn-success {
color: #fff;
background-color: #449d44;
border-color: #398439;
}
.btn-success:active:hover,
.btn-success.active:hover,
.open > .dropdown-toggle.btn-success:hover,
.btn-success:active:focus,
.btn-success.active:focus,
.open > .dropdown-toggle.btn-success:focus,
.btn-success:active.focus,
.btn-success.active.focus,
.open > .dropdown-toggle.btn-success.focus {
color: #fff;
background-color: #398439;
border-color: #255625;
}
.btn-success:active,
.btn-success.active,
.open > .dropdown-toggle.btn-success {
background-image: none;
}
.btn-success.disabled:hover,
.btn-success[disabled]:hover,
fieldset[disabled] .btn-success:hover,
.btn-success.disabled:focus,
.btn-success[disabled]:focus,
fieldset[disabled] .btn-success:focus,
.btn-success.disabled.focus,
.btn-success[disabled].focus,
fieldset[disabled] .btn-success.focus {
background-color: #5cb85c;
border-color: #4cae4c;
}
.btn-success .badge {
color: #5cb85c;
background-color: #fff;
}
.btn-info {
color: #fff;
background-color: #5bc0de;
border-color: #46b8da;
}
.btn-info:focus,
.btn-info.focus {
color: #fff;
background-color: #31b0d5;
border-color: #1b6d85;
}
.btn-info:hover {
color: #fff;
background-color: #31b0d5;
border-color: #269abc;
}
.btn-info:active,
.btn-info.active,
.open > .dropdown-toggle.btn-info {
color: #fff;
background-color: #31b0d5;
border-color: #269abc;
}
.btn-info:active:hover,
.btn-info.active:hover,
.open > .dropdown-toggle.btn-info:hover,
.btn-info:active:focus,
.btn-info.active:focus,
.open > .dropdown-toggle.btn-info:focus,
.btn-info:active.focus,
.btn-info.active.focus,
.open > .dropdown-toggle.btn-info.focus {
color: #fff;
background-color: #269abc;
border-color: #1b6d85;
}
.btn-info:active,
.btn-info.active,
.open > .dropdown-toggle.btn-info {
background-image: none;
}
.btn-info.disabled:hover,
.btn-info[disabled]:hover,
fieldset[disabled] .btn-info:hover,
.btn-info.disabled:focus,
.btn-info[disabled]:focus,
fieldset[disabled] .btn-info:focus,
.btn-info.disabled.focus,
.btn-info[disabled].focus,
fieldset[disabled] .btn-info.focus {
background-color: #5bc0de;
border-color: #46b8da;
}
.btn-info .badge {
color: #5bc0de;
background-color: #fff;
}
.btn-warning {
color: #fff;
background-color: #f0ad4e;
border-color: #eea236;
}
.btn-warning:focus,
.btn-warning.focus {
color: #fff;
background-color: #ec971f;
border-color: #985f0d;
}
.btn-warning:hover {
color: #fff;
background-color: #ec971f;
border-color: #d58512;
}
.btn-warning:active,
.btn-warning.active,
.open > .dropdown-toggle.btn-warning {
color: #fff;
background-color: #ec971f;
border-color: #d58512;
}
.btn-warning:active:hover,
.btn-warning.active:hover,
.open > .dropdown-toggle.btn-warning:hover,
.btn-warning:active:focus,
.btn-warning.active:focus,
.open > .dropdown-toggle.btn-warning:focus,
.btn-warning:active.focus,
.btn-warning.active.focus,
.open > .dropdown-toggle.btn-warning.focus {
color: #fff;
background-color: #d58512;
border-color: #985f0d;
}
.btn-warning:active,
.btn-warning.active,
.open > .dropdown-toggle.btn-warning {
background-image: none;
}
.btn-warning.disabled:hover,
.btn-warning[disabled]:hover,
fieldset[disabled] .btn-warning:hover,
.btn-warning.disabled:focus,
.btn-warning[disabled]:focus,
fieldset[disabled] .btn-warning:focus,
.btn-warning.disabled.focus,
.btn-warning[disabled].focus,
fieldset[disabled] .btn-warning.focus {
background-color: #f0ad4e;
border-color: #eea236;
}
.btn-warning .badge {
color: #f0ad4e;
background-color: #fff;
}
.btn-danger {
color: #fff;
background-color: #d9534f;
border-color: #d43f3a;
}
.btn-danger:focus,
.btn-danger.focus {
color: #fff;
background-color: #c9302c;
border-color: #761c19;
}
.btn-danger:hover {
color: #fff;
background-color: #c9302c;
border-color: #ac2925;
}
.btn-danger:active,
.btn-danger.active,
.open > .dropdown-toggle.btn-danger {
color: #fff;
background-color: #c9302c;
border-color: #ac2925;
}
.btn-danger:active:hover,
.btn-danger.active:hover,
.open > .dropdown-toggle.btn-danger:hover,
.btn-danger:active:focus,
.btn-danger.active:focus,
.open > .dropdown-toggle.btn-danger:focus,
.btn-danger:active.focus,
.btn-danger.active.focus,
.open > .dropdown-toggle.btn-danger.focus {
color: #fff;
background-color: #ac2925;
border-color: #761c19;
}
.btn-danger:active,
.btn-danger.active,
.open > .dropdown-toggle.btn-danger {
background-image: none;
}
.btn-danger.disabled:hover,
.btn-danger[disabled]:hover,
fieldset[disabled] .btn-danger:hover,
.btn-danger.disabled:focus,
.btn-danger[disabled]:focus,
fieldset[disabled] .btn-danger:focus,
.btn-danger.disabled.focus,
.btn-danger[disabled].focus,
fieldset[disabled] .btn-danger.focus {
background-color: #d9534f;
border-color: #d43f3a;
}
.btn-danger .badge {
color: #d9534f;
background-color: #fff;
}
.btn-link {
color: #337ab7;
font-weight: normal;
border-radius: 0;
}
.btn-link,
.btn-link:active,
.btn-link.active,
.btn-link[disabled],
fieldset[disabled] .btn-link {
background-color: transparent;
-webkit-box-shadow: none;
box-shadow: none;
}
.btn-link,
.btn-link:hover,
.btn-link:focus,
.btn-link:active {
border-color: transparent;
}
.btn-link:hover,
.btn-link:focus {
color: #23527c;
text-decoration: underline;
background-color: transparent;
}
.btn-link[disabled]:hover,
fieldset[disabled] .btn-link:hover,
.btn-link[disabled]:focus,
fieldset[disabled] .btn-link:focus {
color: #777777;
text-decoration: none;
}
.btn-lg,
.btn-group-lg > .btn {
padding: 10px 16px;
font-size: 17px;
line-height: 1.3333333;
border-radius: 3px;
}
.btn-sm,
.btn-group-sm > .btn {
padding: 5px 10px;
font-size: 12px;
line-height: 1.5;
border-radius: 1px;
}
.btn-xs,
.btn-group-xs > .btn {
padding: 1px 5px;
font-size: 12px;
line-height: 1.5;
border-radius: 1px;
}
.btn-block {
display: block;
width: 100%;
}
.btn-block + .btn-block {
margin-top: 5px;
}
input[type="submit"].btn-block,
input[type="reset"].btn-block,
input[type="button"].btn-block {
width: 100%;
}
.fade {
opacity: 0;
-webkit-transition: opacity 0.15s linear;
-o-transition: opacity 0.15s linear;
transition: opacity 0.15s linear;
}
.fade.in {
opacity: 1;
}
.collapse {
display: none;
}
.collapse.in {
display: block;
}
tr.collapse.in {
display: table-row;
}
tbody.collapse.in {
display: table-row-group;
}
.collapsing {
position: relative;
height: 0;
overflow: hidden;
-webkit-transition-property: height, visibility;
transition-property: height, visibility;
-webkit-transition-duration: 0.35s;
transition-duration: 0.35s;
-webkit-transition-timing-function: ease;
transition-timing-function: ease;
}
.caret {
display: inline-block;
width: 0;
height: 0;
margin-left: 2px;
vertical-align: middle;
border-top: 4px dashed;
border-top: 4px solid \9;
border-right: 4px solid transparent;
border-left: 4px solid transparent;
}
.dropup,
.dropdown {
position: relative;
}
.dropdown-toggle:focus {
outline: 0;
}
.dropdown-menu {
position: absolute;
top: 100%;
left: 0;
z-index: 1000;
display: none;
float: left;
min-width: 160px;
padding: 5px 0;
margin: 2px 0 0;
list-style: none;
font-size: 13px;
text-align: left;
background-color: #fff;
border: 1px solid #ccc;
border: 1px solid rgba(0, 0, 0, 0.15);
border-radius: 2px;
-webkit-box-shadow: 0 6px 12px rgba(0, 0, 0, 0.175);
box-shadow: 0 6px 12px rgba(0, 0, 0, 0.175);
background-clip: padding-box;
}
.dropdown-menu.pull-right {
right: 0;
left: auto;
}
.dropdown-menu .divider {
height: 1px;
margin: 8px 0;
overflow: hidden;
background-color: #e5e5e5;
}
.dropdown-menu > li > a {
display: block;
padding: 3px 20px;
clear: both;
font-weight: normal;
line-height: 1.42857143;
color: #333333;
white-space: nowrap;
}
.dropdown-menu > li > a:hover,
.dropdown-menu > li > a:focus {
text-decoration: none;
color: #262626;
background-color: #f5f5f5;
}
.dropdown-menu > .active > a,
.dropdown-menu > .active > a:hover,
.dropdown-menu > .active > a:focus {
color: #fff;
text-decoration: none;
outline: 0;
background-color: #337ab7;
}
.dropdown-menu > .disabled > a,
.dropdown-menu > .disabled > a:hover,
.dropdown-menu > .disabled > a:focus {
color: #777777;
}
.dropdown-menu > .disabled > a:hover,
.dropdown-menu > .disabled > a:focus {
text-decoration: none;
background-color: transparent;
background-image: none;
filter: progid:DXImageTransform.Microsoft.gradient(enabled = false);
cursor: not-allowed;
}
.open > .dropdown-menu {
display: block;
}
.open > a {
outline: 0;
}
.dropdown-menu-right {
left: auto;
right: 0;
}
.dropdown-menu-left {
left: 0;
right: auto;
}
.dropdown-header {
display: block;
padding: 3px 20px;
font-size: 12px;
line-height: 1.42857143;
color: #777777;
white-space: nowrap;
}
.dropdown-backdrop {
position: fixed;
left: 0;
right: 0;
bottom: 0;
top: 0;
z-index: 990;
}
.pull-right > .dropdown-menu {
right: 0;
left: auto;
}
.dropup .caret,
.navbar-fixed-bottom .dropdown .caret {
border-top: 0;
border-bottom: 4px dashed;
border-bottom: 4px solid \9;
content: "";
}
.dropup .dropdown-menu,
.navbar-fixed-bottom .dropdown .dropdown-menu {
top: auto;
bottom: 100%;
margin-bottom: 2px;
}
@media (min-width: 541px) {
.navbar-right .dropdown-menu {
left: auto;
right: 0;
}
.navbar-right .dropdown-menu-left {
left: 0;
right: auto;
}
}
.btn-group,
.btn-group-vertical {
position: relative;
display: inline-block;
vertical-align: middle;
}
.btn-group > .btn,
.btn-group-vertical > .btn {
position: relative;
float: left;
}
.btn-group > .btn:hover,
.btn-group-vertical > .btn:hover,
.btn-group > .btn:focus,
.btn-group-vertical > .btn:focus,
.btn-group > .btn:active,
.btn-group-vertical > .btn:active,
.btn-group > .btn.active,
.btn-group-vertical > .btn.active {
z-index: 2;
}
.btn-group .btn + .btn,
.btn-group .btn + .btn-group,
.btn-group .btn-group + .btn,
.btn-group .btn-group + .btn-group {
margin-left: -1px;
}
.btn-toolbar {
margin-left: -5px;
}
.btn-toolbar .btn,
.btn-toolbar .btn-group,
.btn-toolbar .input-group {
float: left;
}
.btn-toolbar > .btn,
.btn-toolbar > .btn-group,
.btn-toolbar > .input-group {
margin-left: 5px;
}
.btn-group > .btn:not(:first-child):not(:last-child):not(.dropdown-toggle) {
border-radius: 0;
}
.btn-group > .btn:first-child {
margin-left: 0;
}
.btn-group > .btn:first-child:not(:last-child):not(.dropdown-toggle) {
border-bottom-right-radius: 0;
border-top-right-radius: 0;
}
.btn-group > .btn:last-child:not(:first-child),
.btn-group > .dropdown-toggle:not(:first-child) {
border-bottom-left-radius: 0;
border-top-left-radius: 0;
}
.btn-group > .btn-group {
float: left;
}
.btn-group > .btn-group:not(:first-child):not(:last-child) > .btn {
border-radius: 0;
}
.btn-group > .btn-group:first-child:not(:last-child) > .btn:last-child,
.btn-group > .btn-group:first-child:not(:last-child) > .dropdown-toggle {
border-bottom-right-radius: 0;
border-top-right-radius: 0;
}
.btn-group > .btn-group:last-child:not(:first-child) > .btn:first-child {
border-bottom-left-radius: 0;
border-top-left-radius: 0;
}
.btn-group .dropdown-toggle:active,
.btn-group.open .dropdown-toggle {
outline: 0;
}
.btn-group > .btn + .dropdown-toggle {
padding-left: 8px;
padding-right: 8px;
}
.btn-group > .btn-lg + .dropdown-toggle {
padding-left: 12px;
padding-right: 12px;
}
.btn-group.open .dropdown-toggle {
-webkit-box-shadow: inset 0 3px 5px rgba(0, 0, 0, 0.125);
box-shadow: inset 0 3px 5px rgba(0, 0, 0, 0.125);
}
.btn-group.open .dropdown-toggle.btn-link {
-webkit-box-shadow: none;
box-shadow: none;
}
.btn .caret {
margin-left: 0;
}
.btn-lg .caret {
border-width: 5px 5px 0;
border-bottom-width: 0;
}
.dropup .btn-lg .caret {
border-width: 0 5px 5px;
}
.btn-group-vertical > .btn,
.btn-group-vertical > .btn-group,
.btn-group-vertical > .btn-group > .btn {
display: block;
float: none;
width: 100%;
max-width: 100%;
}
.btn-group-vertical > .btn-group > .btn {
float: none;
}
.btn-group-vertical > .btn + .btn,
.btn-group-vertical > .btn + .btn-group,
.btn-group-vertical > .btn-group + .btn,
.btn-group-vertical > .btn-group + .btn-group {
margin-top: -1px;
margin-left: 0;
}
.btn-group-vertical > .btn:not(:first-child):not(:last-child) {
border-radius: 0;
}
.btn-group-vertical > .btn:first-child:not(:last-child) {
border-top-right-radius: 2px;
border-top-left-radius: 2px;
border-bottom-right-radius: 0;
border-bottom-left-radius: 0;
}
.btn-group-vertical > .btn:last-child:not(:first-child) {
border-top-right-radius: 0;
border-top-left-radius: 0;
border-bottom-right-radius: 2px;
border-bottom-left-radius: 2px;
}
.btn-group-vertical > .btn-group:not(:first-child):not(:last-child) > .btn {
border-radius: 0;
}
.btn-group-vertical > .btn-group:first-child:not(:last-child) > .btn:last-child,
.btn-group-vertical > .btn-group:first-child:not(:last-child) > .dropdown-toggle {
border-bottom-right-radius: 0;
border-bottom-left-radius: 0;
}
.btn-group-vertical > .btn-group:last-child:not(:first-child) > .btn:first-child {
border-top-right-radius: 0;
border-top-left-radius: 0;
}
.btn-group-justified {
display: table;
width: 100%;
table-layout: fixed;
border-collapse: separate;
}
.btn-group-justified > .btn,
.btn-group-justified > .btn-group {
float: none;
display: table-cell;
width: 1%;
}
.btn-group-justified > .btn-group .btn {
width: 100%;
}
.btn-group-justified > .btn-group .dropdown-menu {
left: auto;
}
[data-toggle="buttons"] > .btn input[type="radio"],
[data-toggle="buttons"] > .btn-group > .btn input[type="radio"],
[data-toggle="buttons"] > .btn input[type="checkbox"],
[data-toggle="buttons"] > .btn-group > .btn input[type="checkbox"] {
position: absolute;
clip: rect(0, 0, 0, 0);
pointer-events: none;
}
.input-group {
position: relative;
display: table;
border-collapse: separate;
}
.input-group[class*="col-"] {
float: none;
padding-left: 0;
padding-right: 0;
}
.input-group .form-control {
position: relative;
z-index: 2;
float: left;
width: 100%;
margin-bottom: 0;
}
.input-group .form-control:focus {
z-index: 3;
}
.input-group-lg > .form-control,
.input-group-lg > .input-group-addon,
.input-group-lg > .input-group-btn > .btn {
height: 45px;
padding: 10px 16px;
font-size: 17px;
line-height: 1.3333333;
border-radius: 3px;
}
select.input-group-lg > .form-control,
select.input-group-lg > .input-group-addon,
select.input-group-lg > .input-group-btn > .btn {
height: 45px;
line-height: 45px;
}
textarea.input-group-lg > .form-control,
textarea.input-group-lg > .input-group-addon,
textarea.input-group-lg > .input-group-btn > .btn,
select[multiple].input-group-lg > .form-control,
select[multiple].input-group-lg > .input-group-addon,
select[multiple].input-group-lg > .input-group-btn > .btn {
height: auto;
}
.input-group-sm > .form-control,
.input-group-sm > .input-group-addon,
.input-group-sm > .input-group-btn > .btn {
height: 30px;
padding: 5px 10px;
font-size: 12px;
line-height: 1.5;
border-radius: 1px;
}
select.input-group-sm > .form-control,
select.input-group-sm > .input-group-addon,
select.input-group-sm > .input-group-btn > .btn {
height: 30px;
line-height: 30px;
}
textarea.input-group-sm > .form-control,
textarea.input-group-sm > .input-group-addon,
textarea.input-group-sm > .input-group-btn > .btn,
select[multiple].input-group-sm > .form-control,
select[multiple].input-group-sm > .input-group-addon,
select[multiple].input-group-sm > .input-group-btn > .btn {
height: auto;
}
.input-group-addon,
.input-group-btn,
.input-group .form-control {
display: table-cell;
}
.input-group-addon:not(:first-child):not(:last-child),
.input-group-btn:not(:first-child):not(:last-child),
.input-group .form-control:not(:first-child):not(:last-child) {
border-radius: 0;
}
.input-group-addon,
.input-group-btn {
width: 1%;
white-space: nowrap;
vertical-align: middle;
}
.input-group-addon {
padding: 6px 12px;
font-size: 13px;
font-weight: normal;
line-height: 1;
color: #555555;
text-align: center;
background-color: #eeeeee;
border: 1px solid #ccc;
border-radius: 2px;
}
.input-group-addon.input-sm {
padding: 5px 10px;
font-size: 12px;
border-radius: 1px;
}
.input-group-addon.input-lg {
padding: 10px 16px;
font-size: 17px;
border-radius: 3px;
}
.input-group-addon input[type="radio"],
.input-group-addon input[type="checkbox"] {
margin-top: 0;
}
.input-group .form-control:first-child,
.input-group-addon:first-child,
.input-group-btn:first-child > .btn,
.input-group-btn:first-child > .btn-group > .btn,
.input-group-btn:first-child > .dropdown-toggle,
.input-group-btn:last-child > .btn:not(:last-child):not(.dropdown-toggle),
.input-group-btn:last-child > .btn-group:not(:last-child) > .btn {
border-bottom-right-radius: 0;
border-top-right-radius: 0;
}
.input-group-addon:first-child {
border-right: 0;
}
.input-group .form-control:last-child,
.input-group-addon:last-child,
.input-group-btn:last-child > .btn,
.input-group-btn:last-child > .btn-group > .btn,
.input-group-btn:last-child > .dropdown-toggle,
.input-group-btn:first-child > .btn:not(:first-child),
.input-group-btn:first-child > .btn-group:not(:first-child) > .btn {
border-bottom-left-radius: 0;
border-top-left-radius: 0;
}
.input-group-addon:last-child {
border-left: 0;
}
.input-group-btn {
position: relative;
font-size: 0;
white-space: nowrap;
}
.input-group-btn > .btn {
position: relative;
}
.input-group-btn > .btn + .btn {
margin-left: -1px;
}
.input-group-btn > .btn:hover,
.input-group-btn > .btn:focus,
.input-group-btn > .btn:active {
z-index: 2;
}
.input-group-btn:first-child > .btn,
.input-group-btn:first-child > .btn-group {
margin-right: -1px;
}
.input-group-btn:last-child > .btn,
.input-group-btn:last-child > .btn-group {
z-index: 2;
margin-left: -1px;
}
.nav {
margin-bottom: 0;
padding-left: 0;
list-style: none;
}
.nav > li {
position: relative;
display: block;
}
.nav > li > a {
position: relative;
display: block;
padding: 10px 15px;
}
.nav > li > a:hover,
.nav > li > a:focus {
text-decoration: none;
background-color: #eeeeee;
}
.nav > li.disabled > a {
color: #777777;
}
.nav > li.disabled > a:hover,
.nav > li.disabled > a:focus {
color: #777777;
text-decoration: none;
background-color: transparent;
cursor: not-allowed;
}
.nav .open > a,
.nav .open > a:hover,
.nav .open > a:focus {
background-color: #eeeeee;
border-color: #337ab7;
}
.nav .nav-divider {
height: 1px;
margin: 8px 0;
overflow: hidden;
background-color: #e5e5e5;
}
.nav > li > a > img {
max-width: none;
}
.nav-tabs {
border-bottom: 1px solid #ddd;
}
.nav-tabs > li {
float: left;
margin-bottom: -1px;
}
.nav-tabs > li > a {
margin-right: 2px;
line-height: 1.42857143;
border: 1px solid transparent;
border-radius: 2px 2px 0 0;
}
.nav-tabs > li > a:hover {
border-color: #eeeeee #eeeeee #ddd;
}
.nav-tabs > li.active > a,
.nav-tabs > li.active > a:hover,
.nav-tabs > li.active > a:focus {
color: #555555;
background-color: #fff;
border: 1px solid #ddd;
border-bottom-color: transparent;
cursor: default;
}
.nav-tabs.nav-justified {
width: 100%;
border-bottom: 0;
}
.nav-tabs.nav-justified > li {
float: none;
}
.nav-tabs.nav-justified > li > a {
text-align: center;
margin-bottom: 5px;
}
.nav-tabs.nav-justified > .dropdown .dropdown-menu {
top: auto;
left: auto;
}
@media (min-width: 768px) {
.nav-tabs.nav-justified > li {
display: table-cell;
width: 1%;
}
.nav-tabs.nav-justified > li > a {
margin-bottom: 0;
}
}
.nav-tabs.nav-justified > li > a {
margin-right: 0;
border-radius: 2px;
}
.nav-tabs.nav-justified > .active > a,
.nav-tabs.nav-justified > .active > a:hover,
.nav-tabs.nav-justified > .active > a:focus {
border: 1px solid #ddd;
}
@media (min-width: 768px) {
.nav-tabs.nav-justified > li > a {
border-bottom: 1px solid #ddd;
border-radius: 2px 2px 0 0;
}
.nav-tabs.nav-justified > .active > a,
.nav-tabs.nav-justified > .active > a:hover,
.nav-tabs.nav-justified > .active > a:focus {
border-bottom-color: #fff;
}
}
.nav-pills > li {
float: left;
}
.nav-pills > li > a {
border-radius: 2px;
}
.nav-pills > li + li {
margin-left: 2px;
}
.nav-pills > li.active > a,
.nav-pills > li.active > a:hover,
.nav-pills > li.active > a:focus {
color: #fff;
background-color: #337ab7;
}
.nav-stacked > li {
float: none;
}
.nav-stacked > li + li {
margin-top: 2px;
margin-left: 0;
}
.nav-justified {
width: 100%;
}
.nav-justified > li {
float: none;
}
.nav-justified > li > a {
text-align: center;
margin-bottom: 5px;
}
.nav-justified > .dropdown .dropdown-menu {
top: auto;
left: auto;
}
@media (min-width: 768px) {
.nav-justified > li {
display: table-cell;
width: 1%;
}
.nav-justified > li > a {
margin-bottom: 0;
}
}
.nav-tabs-justified {
border-bottom: 0;
}
.nav-tabs-justified > li > a {
margin-right: 0;
border-radius: 2px;
}
.nav-tabs-justified > .active > a,
.nav-tabs-justified > .active > a:hover,
.nav-tabs-justified > .active > a:focus {
border: 1px solid #ddd;
}
@media (min-width: 768px) {
.nav-tabs-justified > li > a {
border-bottom: 1px solid #ddd;
border-radius: 2px 2px 0 0;
}
.nav-tabs-justified > .active > a,
.nav-tabs-justified > .active > a:hover,
.nav-tabs-justified > .active > a:focus {
border-bottom-color: #fff;
}
}
.tab-content > .tab-pane {
display: none;
}
.tab-content > .active {
display: block;
}
.nav-tabs .dropdown-menu {
margin-top: -1px;
border-top-right-radius: 0;
border-top-left-radius: 0;
}
.navbar {
position: relative;
min-height: 30px;
margin-bottom: 18px;
border: 1px solid transparent;
}
@media (min-width: 541px) {
.navbar {
border-radius: 2px;
}
}
@media (min-width: 541px) {
.navbar-header {
float: left;
}
}
.navbar-collapse {
overflow-x: visible;
padding-right: 0px;
padding-left: 0px;
border-top: 1px solid transparent;
box-shadow: inset 0 1px 0 rgba(255, 255, 255, 0.1);
-webkit-overflow-scrolling: touch;
}
.navbar-collapse.in {
overflow-y: auto;
}
@media (min-width: 541px) {
.navbar-collapse {
width: auto;
border-top: 0;
box-shadow: none;
}
.navbar-collapse.collapse {
display: block !important;
height: auto !important;
padding-bottom: 0;
overflow: visible !important;
}
.navbar-collapse.in {
overflow-y: visible;
}
.navbar-fixed-top .navbar-collapse,
.navbar-static-top .navbar-collapse,
.navbar-fixed-bottom .navbar-collapse {
padding-left: 0;
padding-right: 0;
}
}
.navbar-fixed-top .navbar-collapse,
.navbar-fixed-bottom .navbar-collapse {
max-height: 340px;
}
@media (max-device-width: 540px) and (orientation: landscape) {
.navbar-fixed-top .navbar-collapse,
.navbar-fixed-bottom .navbar-collapse {
max-height: 200px;
}
}
.container > .navbar-header,
.container-fluid > .navbar-header,
.container > .navbar-collapse,
.container-fluid > .navbar-collapse {
margin-right: 0px;
margin-left: 0px;
}
@media (min-width: 541px) {
.container > .navbar-header,
.container-fluid > .navbar-header,
.container > .navbar-collapse,
.container-fluid > .navbar-collapse {
margin-right: 0;
margin-left: 0;
}
}
.navbar-static-top {
z-index: 1000;
border-width: 0 0 1px;
}
@media (min-width: 541px) {
.navbar-static-top {
border-radius: 0;
}
}
.navbar-fixed-top,
.navbar-fixed-bottom {
position: fixed;
right: 0;
left: 0;
z-index: 1030;
}
@media (min-width: 541px) {
.navbar-fixed-top,
.navbar-fixed-bottom {
border-radius: 0;
}
}
.navbar-fixed-top {
top: 0;
border-width: 0 0 1px;
}
.navbar-fixed-bottom {
bottom: 0;
margin-bottom: 0;
border-width: 1px 0 0;
}
.navbar-brand {
float: left;
padding: 6px 0px;
font-size: 17px;
line-height: 18px;
height: 30px;
}
.navbar-brand:hover,
.navbar-brand:focus {
text-decoration: none;
}
.navbar-brand > img {
display: block;
}
@media (min-width: 541px) {
.navbar > .container .navbar-brand,
.navbar > .container-fluid .navbar-brand {
margin-left: 0px;
}
}
.navbar-toggle {
position: relative;
float: right;
margin-right: 0px;
padding: 9px 10px;
margin-top: -2px;
margin-bottom: -2px;
background-color: transparent;
background-image: none;
border: 1px solid transparent;
border-radius: 2px;
}
.navbar-toggle:focus {
outline: 0;
}
.navbar-toggle .icon-bar {
display: block;
width: 22px;
height: 2px;
border-radius: 1px;
}
.navbar-toggle .icon-bar + .icon-bar {
margin-top: 4px;
}
@media (min-width: 541px) {
.navbar-toggle {
display: none;
}
}
.navbar-nav {
margin: 3px 0px;
}
.navbar-nav > li > a {
padding-top: 10px;
padding-bottom: 10px;
line-height: 18px;
}
@media (max-width: 540px) {
.navbar-nav .open .dropdown-menu {
position: static;
float: none;
width: auto;
margin-top: 0;
background-color: transparent;
border: 0;
box-shadow: none;
}
.navbar-nav .open .dropdown-menu > li > a,
.navbar-nav .open .dropdown-menu .dropdown-header {
padding: 5px 15px 5px 25px;
}
.navbar-nav .open .dropdown-menu > li > a {
line-height: 18px;
}
.navbar-nav .open .dropdown-menu > li > a:hover,
.navbar-nav .open .dropdown-menu > li > a:focus {
background-image: none;
}
}
@media (min-width: 541px) {
.navbar-nav {
float: left;
margin: 0;
}
.navbar-nav > li {
float: left;
}
.navbar-nav > li > a {
padding-top: 6px;
padding-bottom: 6px;
}
}
.navbar-form {
margin-left: 0px;
margin-right: 0px;
padding: 10px 0px;
border-top: 1px solid transparent;
border-bottom: 1px solid transparent;
-webkit-box-shadow: inset 0 1px 0 rgba(255, 255, 255, 0.1), 0 1px 0 rgba(255, 255, 255, 0.1);
box-shadow: inset 0 1px 0 rgba(255, 255, 255, 0.1), 0 1px 0 rgba(255, 255, 255, 0.1);
margin-top: -1px;
margin-bottom: -1px;
}
@media (min-width: 768px) {
.navbar-form .form-group {
display: inline-block;
margin-bottom: 0;
vertical-align: middle;
}
.navbar-form .form-control {
display: inline-block;
width: auto;
vertical-align: middle;
}
.navbar-form .form-control-static {
display: inline-block;
}
.navbar-form .input-group {
display: inline-table;
vertical-align: middle;
}
.navbar-form .input-group .input-group-addon,
.navbar-form .input-group .input-group-btn,
.navbar-form .input-group .form-control {
width: auto;
}
.navbar-form .input-group > .form-control {
width: 100%;
}
.navbar-form .control-label {
margin-bottom: 0;
vertical-align: middle;
}
.navbar-form .radio,
.navbar-form .checkbox {
display: inline-block;
margin-top: 0;
margin-bottom: 0;
vertical-align: middle;
}
.navbar-form .radio label,
.navbar-form .checkbox label {
padding-left: 0;
}
.navbar-form .radio input[type="radio"],
.navbar-form .checkbox input[type="checkbox"] {
position: relative;
margin-left: 0;
}
.navbar-form .has-feedback .form-control-feedback {
top: 0;
}
}
@media (max-width: 540px) {
.navbar-form .form-group {
margin-bottom: 5px;
}
.navbar-form .form-group:last-child {
margin-bottom: 0;
}
}
@media (min-width: 541px) {
.navbar-form {
width: auto;
border: 0;
margin-left: 0;
margin-right: 0;
padding-top: 0;
padding-bottom: 0;
-webkit-box-shadow: none;
box-shadow: none;
}
}
.navbar-nav > li > .dropdown-menu {
margin-top: 0;
border-top-right-radius: 0;
border-top-left-radius: 0;
}
.navbar-fixed-bottom .navbar-nav > li > .dropdown-menu {
margin-bottom: 0;
border-top-right-radius: 2px;
border-top-left-radius: 2px;
border-bottom-right-radius: 0;
border-bottom-left-radius: 0;
}
.navbar-btn {
margin-top: -1px;
margin-bottom: -1px;
}
.navbar-btn.btn-sm {
margin-top: 0px;
margin-bottom: 0px;
}
.navbar-btn.btn-xs {
margin-top: 4px;
margin-bottom: 4px;
}
.navbar-text {
margin-top: 6px;
margin-bottom: 6px;
}
@media (min-width: 541px) {
.navbar-text {
float: left;
margin-left: 0px;
margin-right: 0px;
}
}
@media (min-width: 541px) {
.navbar-left {
float: left !important;
float: left;
}
.navbar-right {
float: right !important;
float: right;
margin-right: 0px;
}
.navbar-right ~ .navbar-right {
margin-right: 0;
}
}
.navbar-default {
background-color: #f8f8f8;
border-color: #e7e7e7;
}
.navbar-default .navbar-brand {
color: #777;
}
.navbar-default .navbar-brand:hover,
.navbar-default .navbar-brand:focus {
color: #5e5e5e;
background-color: transparent;
}
.navbar-default .navbar-text {
color: #777;
}
.navbar-default .navbar-nav > li > a {
color: #777;
}
.navbar-default .navbar-nav > li > a:hover,
.navbar-default .navbar-nav > li > a:focus {
color: #333;
background-color: transparent;
}
.navbar-default .navbar-nav > .active > a,
.navbar-default .navbar-nav > .active > a:hover,
.navbar-default .navbar-nav > .active > a:focus {
color: #555;
background-color: #e7e7e7;
}
.navbar-default .navbar-nav > .disabled > a,
.navbar-default .navbar-nav > .disabled > a:hover,
.navbar-default .navbar-nav > .disabled > a:focus {
color: #ccc;
background-color: transparent;
}
.navbar-default .navbar-toggle {
border-color: #ddd;
}
.navbar-default .navbar-toggle:hover,
.navbar-default .navbar-toggle:focus {
background-color: #ddd;
}
.navbar-default .navbar-toggle .icon-bar {
background-color: #888;
}
.navbar-default .navbar-collapse,
.navbar-default .navbar-form {
border-color: #e7e7e7;
}
.navbar-default .navbar-nav > .open > a,
.navbar-default .navbar-nav > .open > a:hover,
.navbar-default .navbar-nav > .open > a:focus {
background-color: #e7e7e7;
color: #555;
}
@media (max-width: 540px) {
.navbar-default .navbar-nav .open .dropdown-menu > li > a {
color: #777;
}
.navbar-default .navbar-nav .open .dropdown-menu > li > a:hover,
.navbar-default .navbar-nav .open .dropdown-menu > li > a:focus {
color: #333;
background-color: transparent;
}
.navbar-default .navbar-nav .open .dropdown-menu > .active > a,
.navbar-default .navbar-nav .open .dropdown-menu > .active > a:hover,
.navbar-default .navbar-nav .open .dropdown-menu > .active > a:focus {
color: #555;
background-color: #e7e7e7;
}
.navbar-default .navbar-nav .open .dropdown-menu > .disabled > a,
.navbar-default .navbar-nav .open .dropdown-menu > .disabled > a:hover,
.navbar-default .navbar-nav .open .dropdown-menu > .disabled > a:focus {
color: #ccc;
background-color: transparent;
}
}
.navbar-default .navbar-link {
color: #777;
}
.navbar-default .navbar-link:hover {
color: #333;
}
.navbar-default .btn-link {
color: #777;
}
.navbar-default .btn-link:hover,
.navbar-default .btn-link:focus {
color: #333;
}
.navbar-default .btn-link[disabled]:hover,
fieldset[disabled] .navbar-default .btn-link:hover,
.navbar-default .btn-link[disabled]:focus,
fieldset[disabled] .navbar-default .btn-link:focus {
color: #ccc;
}
.navbar-inverse {
background-color: #222;
border-color: #080808;
}
.navbar-inverse .navbar-brand {
color: #9d9d9d;
}
.navbar-inverse .navbar-brand:hover,
.navbar-inverse .navbar-brand:focus {
color: #fff;
background-color: transparent;
}
.navbar-inverse .navbar-text {
color: #9d9d9d;
}
.navbar-inverse .navbar-nav > li > a {
color: #9d9d9d;
}
.navbar-inverse .navbar-nav > li > a:hover,
.navbar-inverse .navbar-nav > li > a:focus {
color: #fff;
background-color: transparent;
}
.navbar-inverse .navbar-nav > .active > a,
.navbar-inverse .navbar-nav > .active > a:hover,
.navbar-inverse .navbar-nav > .active > a:focus {
color: #fff;
background-color: #080808;
}
.navbar-inverse .navbar-nav > .disabled > a,
.navbar-inverse .navbar-nav > .disabled > a:hover,
.navbar-inverse .navbar-nav > .disabled > a:focus {
color: #444;
background-color: transparent;
}
.navbar-inverse .navbar-toggle {
border-color: #333;
}
.navbar-inverse .navbar-toggle:hover,
.navbar-inverse .navbar-toggle:focus {
background-color: #333;
}
.navbar-inverse .navbar-toggle .icon-bar {
background-color: #fff;
}
.navbar-inverse .navbar-collapse,
.navbar-inverse .navbar-form {
border-color: #101010;
}
.navbar-inverse .navbar-nav > .open > a,
.navbar-inverse .navbar-nav > .open > a:hover,
.navbar-inverse .navbar-nav > .open > a:focus {
background-color: #080808;
color: #fff;
}
@media (max-width: 540px) {
.navbar-inverse .navbar-nav .open .dropdown-menu > .dropdown-header {
border-color: #080808;
}
.navbar-inverse .navbar-nav .open .dropdown-menu .divider {
background-color: #080808;
}
.navbar-inverse .navbar-nav .open .dropdown-menu > li > a {
color: #9d9d9d;
}
.navbar-inverse .navbar-nav .open .dropdown-menu > li > a:hover,
.navbar-inverse .navbar-nav .open .dropdown-menu > li > a:focus {
color: #fff;
background-color: transparent;
}
.navbar-inverse .navbar-nav .open .dropdown-menu > .active > a,
.navbar-inverse .navbar-nav .open .dropdown-menu > .active > a:hover,
.navbar-inverse .navbar-nav .open .dropdown-menu > .active > a:focus {
color: #fff;
background-color: #080808;
}
.navbar-inverse .navbar-nav .open .dropdown-menu > .disabled > a,
.navbar-inverse .navbar-nav .open .dropdown-menu > .disabled > a:hover,
.navbar-inverse .navbar-nav .open .dropdown-menu > .disabled > a:focus {
color: #444;
background-color: transparent;
}
}
.navbar-inverse .navbar-link {
color: #9d9d9d;
}
.navbar-inverse .navbar-link:hover {
color: #fff;
}
.navbar-inverse .btn-link {
color: #9d9d9d;
}
.navbar-inverse .btn-link:hover,
.navbar-inverse .btn-link:focus {
color: #fff;
}
.navbar-inverse .btn-link[disabled]:hover,
fieldset[disabled] .navbar-inverse .btn-link:hover,
.navbar-inverse .btn-link[disabled]:focus,
fieldset[disabled] .navbar-inverse .btn-link:focus {
color: #444;
}
.breadcrumb {
padding: 8px 15px;
margin-bottom: 18px;
list-style: none;
background-color: #f5f5f5;
border-radius: 2px;
}
.breadcrumb > li {
display: inline-block;
}
.breadcrumb > li + li:before {
content: "/\00a0";
padding: 0 5px;
color: #5e5e5e;
}
.breadcrumb > .active {
color: #777777;
}
.pagination {
display: inline-block;
padding-left: 0;
margin: 18px 0;
border-radius: 2px;
}
.pagination > li {
display: inline;
}
.pagination > li > a,
.pagination > li > span {
position: relative;
float: left;
padding: 6px 12px;
line-height: 1.42857143;
text-decoration: none;
color: #337ab7;
background-color: #fff;
border: 1px solid #ddd;
margin-left: -1px;
}
.pagination > li:first-child > a,
.pagination > li:first-child > span {
margin-left: 0;
border-bottom-left-radius: 2px;
border-top-left-radius: 2px;
}
.pagination > li:last-child > a,
.pagination > li:last-child > span {
border-bottom-right-radius: 2px;
border-top-right-radius: 2px;
}
.pagination > li > a:hover,
.pagination > li > span:hover,
.pagination > li > a:focus,
.pagination > li > span:focus {
z-index: 2;
color: #23527c;
background-color: #eeeeee;
border-color: #ddd;
}
.pagination > .active > a,
.pagination > .active > span,
.pagination > .active > a:hover,
.pagination > .active > span:hover,
.pagination > .active > a:focus,
.pagination > .active > span:focus {
z-index: 3;
color: #fff;
background-color: #337ab7;
border-color: #337ab7;
cursor: default;
}
.pagination > .disabled > span,
.pagination > .disabled > span:hover,
.pagination > .disabled > span:focus,
.pagination > .disabled > a,
.pagination > .disabled > a:hover,
.pagination > .disabled > a:focus {
color: #777777;
background-color: #fff;
border-color: #ddd;
cursor: not-allowed;
}
.pagination-lg > li > a,
.pagination-lg > li > span {
padding: 10px 16px;
font-size: 17px;
line-height: 1.3333333;
}
.pagination-lg > li:first-child > a,
.pagination-lg > li:first-child > span {
border-bottom-left-radius: 3px;
border-top-left-radius: 3px;
}
.pagination-lg > li:last-child > a,
.pagination-lg > li:last-child > span {
border-bottom-right-radius: 3px;
border-top-right-radius: 3px;
}
.pagination-sm > li > a,
.pagination-sm > li > span {
padding: 5px 10px;
font-size: 12px;
line-height: 1.5;
}
.pagination-sm > li:first-child > a,
.pagination-sm > li:first-child > span {
border-bottom-left-radius: 1px;
border-top-left-radius: 1px;
}
.pagination-sm > li:last-child > a,
.pagination-sm > li:last-child > span {
border-bottom-right-radius: 1px;
border-top-right-radius: 1px;
}
.pager {
padding-left: 0;
margin: 18px 0;
list-style: none;
text-align: center;
}
.pager li {
display: inline;
}
.pager li > a,
.pager li > span {
display: inline-block;
padding: 5px 14px;
background-color: #fff;
border: 1px solid #ddd;
border-radius: 15px;
}
.pager li > a:hover,
.pager li > a:focus {
text-decoration: none;
background-color: #eeeeee;
}
.pager .next > a,
.pager .next > span {
float: right;
}
.pager .previous > a,
.pager .previous > span {
float: left;
}
.pager .disabled > a,
.pager .disabled > a:hover,
.pager .disabled > a:focus,
.pager .disabled > span {
color: #777777;
background-color: #fff;
cursor: not-allowed;
}
.label {
display: inline;
padding: .2em .6em .3em;
font-size: 75%;
font-weight: bold;
line-height: 1;
color: #fff;
text-align: center;
white-space: nowrap;
vertical-align: baseline;
border-radius: .25em;
}
a.label:hover,
a.label:focus {
color: #fff;
text-decoration: none;
cursor: pointer;
}
.label:empty {
display: none;
}
.btn .label {
position: relative;
top: -1px;
}
.label-default {
background-color: #777777;
}
.label-default[href]:hover,
.label-default[href]:focus {
background-color: #5e5e5e;
}
.label-primary {
background-color: #337ab7;
}
.label-primary[href]:hover,
.label-primary[href]:focus {
background-color: #286090;
}
.label-success {
background-color: #5cb85c;
}
.label-success[href]:hover,
.label-success[href]:focus {
background-color: #449d44;
}
.label-info {
background-color: #5bc0de;
}
.label-info[href]:hover,
.label-info[href]:focus {
background-color: #31b0d5;
}
.label-warning {
background-color: #f0ad4e;
}
.label-warning[href]:hover,
.label-warning[href]:focus {
background-color: #ec971f;
}
.label-danger {
background-color: #d9534f;
}
.label-danger[href]:hover,
.label-danger[href]:focus {
background-color: #c9302c;
}
.badge {
display: inline-block;
min-width: 10px;
padding: 3px 7px;
font-size: 12px;
font-weight: bold;
color: #fff;
line-height: 1;
vertical-align: middle;
white-space: nowrap;
text-align: center;
background-color: #777777;
border-radius: 10px;
}
.badge:empty {
display: none;
}
.btn .badge {
position: relative;
top: -1px;
}
.btn-xs .badge,
.btn-group-xs > .btn .badge {
top: 0;
padding: 1px 5px;
}
a.badge:hover,
a.badge:focus {
color: #fff;
text-decoration: none;
cursor: pointer;
}
.list-group-item.active > .badge,
.nav-pills > .active > a > .badge {
color: #337ab7;
background-color: #fff;
}
.list-group-item > .badge {
float: right;
}
.list-group-item > .badge + .badge {
margin-right: 5px;
}
.nav-pills > li > a > .badge {
margin-left: 3px;
}
.jumbotron {
padding-top: 30px;
padding-bottom: 30px;
margin-bottom: 30px;
color: inherit;
background-color: #eeeeee;
}
.jumbotron h1,
.jumbotron .h1 {
color: inherit;
}
.jumbotron p {
margin-bottom: 15px;
font-size: 20px;
font-weight: 200;
}
.jumbotron > hr {
border-top-color: #d5d5d5;
}
.container .jumbotron,
.container-fluid .jumbotron {
border-radius: 3px;
padding-left: 0px;
padding-right: 0px;
}
.jumbotron .container {
max-width: 100%;
}
@media screen and (min-width: 768px) {
.jumbotron {
padding-top: 48px;
padding-bottom: 48px;
}
.container .jumbotron,
.container-fluid .jumbotron {
padding-left: 60px;
padding-right: 60px;
}
.jumbotron h1,
.jumbotron .h1 {
font-size: 59px;
}
}
.thumbnail {
display: block;
padding: 4px;
margin-bottom: 18px;
line-height: 1.42857143;
background-color: #fff;
border: 1px solid #ddd;
border-radius: 2px;
-webkit-transition: border 0.2s ease-in-out;
-o-transition: border 0.2s ease-in-out;
transition: border 0.2s ease-in-out;
}
.thumbnail > img,
.thumbnail a > img {
margin-left: auto;
margin-right: auto;
}
a.thumbnail:hover,
a.thumbnail:focus,
a.thumbnail.active {
border-color: #337ab7;
}
.thumbnail .caption {
padding: 9px;
color: #000;
}
.alert {
padding: 15px;
margin-bottom: 18px;
border: 1px solid transparent;
border-radius: 2px;
}
.alert h4 {
margin-top: 0;
color: inherit;
}
.alert .alert-link {
font-weight: bold;
}
.alert > p,
.alert > ul {
margin-bottom: 0;
}
.alert > p + p {
margin-top: 5px;
}
.alert-dismissable,
.alert-dismissible {
padding-right: 35px;
}
.alert-dismissable .close,
.alert-dismissible .close {
position: relative;
top: -2px;
right: -21px;
color: inherit;
}
.alert-success {
background-color: #dff0d8;
border-color: #d6e9c6;
color: #3c763d;
}
.alert-success hr {
border-top-color: #c9e2b3;
}
.alert-success .alert-link {
color: #2b542c;
}
.alert-info {
background-color: #d9edf7;
border-color: #bce8f1;
color: #31708f;
}
.alert-info hr {
border-top-color: #a6e1ec;
}
.alert-info .alert-link {
color: #245269;
}
.alert-warning {
background-color: #fcf8e3;
border-color: #faebcc;
color: #8a6d3b;
}
.alert-warning hr {
border-top-color: #f7e1b5;
}
.alert-warning .alert-link {
color: #66512c;
}
.alert-danger {
background-color: #f2dede;
border-color: #ebccd1;
color: #a94442;
}
.alert-danger hr {
border-top-color: #e4b9c0;
}
.alert-danger .alert-link {
color: #843534;
}
@-webkit-keyframes progress-bar-stripes {
from {
background-position: 40px 0;
}
to {
background-position: 0 0;
}
}
@keyframes progress-bar-stripes {
from {
background-position: 40px 0;
}
to {
background-position: 0 0;
}
}
.progress {
overflow: hidden;
height: 18px;
margin-bottom: 18px;
background-color: #f5f5f5;
border-radius: 2px;
-webkit-box-shadow: inset 0 1px 2px rgba(0, 0, 0, 0.1);
box-shadow: inset 0 1px 2px rgba(0, 0, 0, 0.1);
}
.progress-bar {
float: left;
width: 0%;
height: 100%;
font-size: 12px;
line-height: 18px;
color: #fff;
text-align: center;
background-color: #337ab7;
-webkit-box-shadow: inset 0 -1px 0 rgba(0, 0, 0, 0.15);
box-shadow: inset 0 -1px 0 rgba(0, 0, 0, 0.15);
-webkit-transition: width 0.6s ease;
-o-transition: width 0.6s ease;
transition: width 0.6s ease;
}
.progress-striped .progress-bar,
.progress-bar-striped {
background-image: -webkit-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: -o-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-size: 40px 40px;
}
.progress.active .progress-bar,
.progress-bar.active {
-webkit-animation: progress-bar-stripes 2s linear infinite;
-o-animation: progress-bar-stripes 2s linear infinite;
animation: progress-bar-stripes 2s linear infinite;
}
.progress-bar-success {
background-color: #5cb85c;
}
.progress-striped .progress-bar-success {
background-image: -webkit-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: -o-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
}
.progress-bar-info {
background-color: #5bc0de;
}
.progress-striped .progress-bar-info {
background-image: -webkit-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: -o-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
}
.progress-bar-warning {
background-color: #f0ad4e;
}
.progress-striped .progress-bar-warning {
background-image: -webkit-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: -o-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
}
.progress-bar-danger {
background-color: #d9534f;
}
.progress-striped .progress-bar-danger {
background-image: -webkit-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: -o-linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
background-image: linear-gradient(45deg, rgba(255, 255, 255, 0.15) 25%, transparent 25%, transparent 50%, rgba(255, 255, 255, 0.15) 50%, rgba(255, 255, 255, 0.15) 75%, transparent 75%, transparent);
}
.media {
margin-top: 15px;
}
.media:first-child {
margin-top: 0;
}
.media,
.media-body {
zoom: 1;
overflow: hidden;
}
.media-body {
width: 10000px;
}
.media-object {
display: block;
}
.media-object.img-thumbnail {
max-width: none;
}
.media-right,
.media > .pull-right {
padding-left: 10px;
}
.media-left,
.media > .pull-left {
padding-right: 10px;
}
.media-left,
.media-right,
.media-body {
display: table-cell;
vertical-align: top;
}
.media-middle {
vertical-align: middle;
}
.media-bottom {
vertical-align: bottom;
}
.media-heading {
margin-top: 0;
margin-bottom: 5px;
}
.media-list {
padding-left: 0;
list-style: none;
}
.list-group {
margin-bottom: 20px;
padding-left: 0;
}
.list-group-item {
position: relative;
display: block;
padding: 10px 15px;
margin-bottom: -1px;
background-color: #fff;
border: 1px solid #ddd;
}
.list-group-item:first-child {
border-top-right-radius: 2px;
border-top-left-radius: 2px;
}
.list-group-item:last-child {
margin-bottom: 0;
border-bottom-right-radius: 2px;
border-bottom-left-radius: 2px;
}
a.list-group-item,
button.list-group-item {
color: #555;
}
a.list-group-item .list-group-item-heading,
button.list-group-item .list-group-item-heading {
color: #333;
}
a.list-group-item:hover,
button.list-group-item:hover,
a.list-group-item:focus,
button.list-group-item:focus {
text-decoration: none;
color: #555;
background-color: #f5f5f5;
}
button.list-group-item {
width: 100%;
text-align: left;
}
.list-group-item.disabled,
.list-group-item.disabled:hover,
.list-group-item.disabled:focus {
background-color: #eeeeee;
color: #777777;
cursor: not-allowed;
}
.list-group-item.disabled .list-group-item-heading,
.list-group-item.disabled:hover .list-group-item-heading,
.list-group-item.disabled:focus .list-group-item-heading {
color: inherit;
}
.list-group-item.disabled .list-group-item-text,
.list-group-item.disabled:hover .list-group-item-text,
.list-group-item.disabled:focus .list-group-item-text {
color: #777777;
}
.list-group-item.active,
.list-group-item.active:hover,
.list-group-item.active:focus {
z-index: 2;
color: #fff;
background-color: #337ab7;
border-color: #337ab7;
}
.list-group-item.active .list-group-item-heading,
.list-group-item.active:hover .list-group-item-heading,
.list-group-item.active:focus .list-group-item-heading,
.list-group-item.active .list-group-item-heading > small,
.list-group-item.active:hover .list-group-item-heading > small,
.list-group-item.active:focus .list-group-item-heading > small,
.list-group-item.active .list-group-item-heading > .small,
.list-group-item.active:hover .list-group-item-heading > .small,
.list-group-item.active:focus .list-group-item-heading > .small {
color: inherit;
}
.list-group-item.active .list-group-item-text,
.list-group-item.active:hover .list-group-item-text,
.list-group-item.active:focus .list-group-item-text {
color: #c7ddef;
}
.list-group-item-success {
color: #3c763d;
background-color: #dff0d8;
}
a.list-group-item-success,
button.list-group-item-success {
color: #3c763d;
}
a.list-group-item-success .list-group-item-heading,
button.list-group-item-success .list-group-item-heading {
color: inherit;
}
a.list-group-item-success:hover,
button.list-group-item-success:hover,
a.list-group-item-success:focus,
button.list-group-item-success:focus {
color: #3c763d;
background-color: #d0e9c6;
}
a.list-group-item-success.active,
button.list-group-item-success.active,
a.list-group-item-success.active:hover,
button.list-group-item-success.active:hover,
a.list-group-item-success.active:focus,
button.list-group-item-success.active:focus {
color: #fff;
background-color: #3c763d;
border-color: #3c763d;
}
.list-group-item-info {
color: #31708f;
background-color: #d9edf7;
}
a.list-group-item-info,
button.list-group-item-info {
color: #31708f;
}
a.list-group-item-info .list-group-item-heading,
button.list-group-item-info .list-group-item-heading {
color: inherit;
}
a.list-group-item-info:hover,
button.list-group-item-info:hover,
a.list-group-item-info:focus,
button.list-group-item-info:focus {
color: #31708f;
background-color: #c4e3f3;
}
a.list-group-item-info.active,
button.list-group-item-info.active,
a.list-group-item-info.active:hover,
button.list-group-item-info.active:hover,
a.list-group-item-info.active:focus,
button.list-group-item-info.active:focus {
color: #fff;
background-color: #31708f;
border-color: #31708f;
}
.list-group-item-warning {
color: #8a6d3b;
background-color: #fcf8e3;
}
a.list-group-item-warning,
button.list-group-item-warning {
color: #8a6d3b;
}
a.list-group-item-warning .list-group-item-heading,
button.list-group-item-warning .list-group-item-heading {
color: inherit;
}
a.list-group-item-warning:hover,
button.list-group-item-warning:hover,
a.list-group-item-warning:focus,
button.list-group-item-warning:focus {
color: #8a6d3b;
background-color: #faf2cc;
}
a.list-group-item-warning.active,
button.list-group-item-warning.active,
a.list-group-item-warning.active:hover,
button.list-group-item-warning.active:hover,
a.list-group-item-warning.active:focus,
button.list-group-item-warning.active:focus {
color: #fff;
background-color: #8a6d3b;
border-color: #8a6d3b;
}
.list-group-item-danger {
color: #a94442;
background-color: #f2dede;
}
a.list-group-item-danger,
button.list-group-item-danger {
color: #a94442;
}
a.list-group-item-danger .list-group-item-heading,
button.list-group-item-danger .list-group-item-heading {
color: inherit;
}
a.list-group-item-danger:hover,
button.list-group-item-danger:hover,
a.list-group-item-danger:focus,
button.list-group-item-danger:focus {
color: #a94442;
background-color: #ebcccc;
}
a.list-group-item-danger.active,
button.list-group-item-danger.active,
a.list-group-item-danger.active:hover,
button.list-group-item-danger.active:hover,
a.list-group-item-danger.active:focus,
button.list-group-item-danger.active:focus {
color: #fff;
background-color: #a94442;
border-color: #a94442;
}
.list-group-item-heading {
margin-top: 0;
margin-bottom: 5px;
}
.list-group-item-text {
margin-bottom: 0;
line-height: 1.3;
}
.panel {
margin-bottom: 18px;
background-color: #fff;
border: 1px solid transparent;
border-radius: 2px;
-webkit-box-shadow: 0 1px 1px rgba(0, 0, 0, 0.05);
box-shadow: 0 1px 1px rgba(0, 0, 0, 0.05);
}
.panel-body {
padding: 15px;
}
.panel-heading {
padding: 10px 15px;
border-bottom: 1px solid transparent;
border-top-right-radius: 1px;
border-top-left-radius: 1px;
}
.panel-heading > .dropdown .dropdown-toggle {
color: inherit;
}
.panel-title {
margin-top: 0;
margin-bottom: 0;
font-size: 15px;
color: inherit;
}
.panel-title > a,
.panel-title > small,
.panel-title > .small,
.panel-title > small > a,
.panel-title > .small > a {
color: inherit;
}
.panel-footer {
padding: 10px 15px;
background-color: #f5f5f5;
border-top: 1px solid #ddd;
border-bottom-right-radius: 1px;
border-bottom-left-radius: 1px;
}
.panel > .list-group,
.panel > .panel-collapse > .list-group {
margin-bottom: 0;
}
.panel > .list-group .list-group-item,
.panel > .panel-collapse > .list-group .list-group-item {
border-width: 1px 0;
border-radius: 0;
}
.panel > .list-group:first-child .list-group-item:first-child,
.panel > .panel-collapse > .list-group:first-child .list-group-item:first-child {
border-top: 0;
border-top-right-radius: 1px;
border-top-left-radius: 1px;
}
.panel > .list-group:last-child .list-group-item:last-child,
.panel > .panel-collapse > .list-group:last-child .list-group-item:last-child {
border-bottom: 0;
border-bottom-right-radius: 1px;
border-bottom-left-radius: 1px;
}
.panel > .panel-heading + .panel-collapse > .list-group .list-group-item:first-child {
border-top-right-radius: 0;
border-top-left-radius: 0;
}
.panel-heading + .list-group .list-group-item:first-child {
border-top-width: 0;
}
.list-group + .panel-footer {
border-top-width: 0;
}
.panel > .table,
.panel > .table-responsive > .table,
.panel > .panel-collapse > .table {
margin-bottom: 0;
}
.panel > .table caption,
.panel > .table-responsive > .table caption,
.panel > .panel-collapse > .table caption {
padding-left: 15px;
padding-right: 15px;
}
.panel > .table:first-child,
.panel > .table-responsive:first-child > .table:first-child {
border-top-right-radius: 1px;
border-top-left-radius: 1px;
}
.panel > .table:first-child > thead:first-child > tr:first-child,
.panel > .table-responsive:first-child > .table:first-child > thead:first-child > tr:first-child,
.panel > .table:first-child > tbody:first-child > tr:first-child,
.panel > .table-responsive:first-child > .table:first-child > tbody:first-child > tr:first-child {
border-top-left-radius: 1px;
border-top-right-radius: 1px;
}
.panel > .table:first-child > thead:first-child > tr:first-child td:first-child,
.panel > .table-responsive:first-child > .table:first-child > thead:first-child > tr:first-child td:first-child,
.panel > .table:first-child > tbody:first-child > tr:first-child td:first-child,
.panel > .table-responsive:first-child > .table:first-child > tbody:first-child > tr:first-child td:first-child,
.panel > .table:first-child > thead:first-child > tr:first-child th:first-child,
.panel > .table-responsive:first-child > .table:first-child > thead:first-child > tr:first-child th:first-child,
.panel > .table:first-child > tbody:first-child > tr:first-child th:first-child,
.panel > .table-responsive:first-child > .table:first-child > tbody:first-child > tr:first-child th:first-child {
border-top-left-radius: 1px;
}
.panel > .table:first-child > thead:first-child > tr:first-child td:last-child,
.panel > .table-responsive:first-child > .table:first-child > thead:first-child > tr:first-child td:last-child,
.panel > .table:first-child > tbody:first-child > tr:first-child td:last-child,
.panel > .table-responsive:first-child > .table:first-child > tbody:first-child > tr:first-child td:last-child,
.panel > .table:first-child > thead:first-child > tr:first-child th:last-child,
.panel > .table-responsive:first-child > .table:first-child > thead:first-child > tr:first-child th:last-child,
.panel > .table:first-child > tbody:first-child > tr:first-child th:last-child,
.panel > .table-responsive:first-child > .table:first-child > tbody:first-child > tr:first-child th:last-child {
border-top-right-radius: 1px;
}
.panel > .table:last-child,
.panel > .table-responsive:last-child > .table:last-child {
border-bottom-right-radius: 1px;
border-bottom-left-radius: 1px;
}
.panel > .table:last-child > tbody:last-child > tr:last-child,
.panel > .table-responsive:last-child > .table:last-child > tbody:last-child > tr:last-child,
.panel > .table:last-child > tfoot:last-child > tr:last-child,
.panel > .table-responsive:last-child > .table:last-child > tfoot:last-child > tr:last-child {
border-bottom-left-radius: 1px;
border-bottom-right-radius: 1px;
}
.panel > .table:last-child > tbody:last-child > tr:last-child td:first-child,
.panel > .table-responsive:last-child > .table:last-child > tbody:last-child > tr:last-child td:first-child,
.panel > .table:last-child > tfoot:last-child > tr:last-child td:first-child,
.panel > .table-responsive:last-child > .table:last-child > tfoot:last-child > tr:last-child td:first-child,
.panel > .table:last-child > tbody:last-child > tr:last-child th:first-child,
.panel > .table-responsive:last-child > .table:last-child > tbody:last-child > tr:last-child th:first-child,
.panel > .table:last-child > tfoot:last-child > tr:last-child th:first-child,
.panel > .table-responsive:last-child > .table:last-child > tfoot:last-child > tr:last-child th:first-child {
border-bottom-left-radius: 1px;
}
.panel > .table:last-child > tbody:last-child > tr:last-child td:last-child,
.panel > .table-responsive:last-child > .table:last-child > tbody:last-child > tr:last-child td:last-child,
.panel > .table:last-child > tfoot:last-child > tr:last-child td:last-child,
.panel > .table-responsive:last-child > .table:last-child > tfoot:last-child > tr:last-child td:last-child,
.panel > .table:last-child > tbody:last-child > tr:last-child th:last-child,
.panel > .table-responsive:last-child > .table:last-child > tbody:last-child > tr:last-child th:last-child,
.panel > .table:last-child > tfoot:last-child > tr:last-child th:last-child,
.panel > .table-responsive:last-child > .table:last-child > tfoot:last-child > tr:last-child th:last-child {
border-bottom-right-radius: 1px;
}
.panel > .panel-body + .table,
.panel > .panel-body + .table-responsive,
.panel > .table + .panel-body,
.panel > .table-responsive + .panel-body {
border-top: 1px solid #ddd;
}
.panel > .table > tbody:first-child > tr:first-child th,
.panel > .table > tbody:first-child > tr:first-child td {
border-top: 0;
}
.panel > .table-bordered,
.panel > .table-responsive > .table-bordered {
border: 0;
}
.panel > .table-bordered > thead > tr > th:first-child,
.panel > .table-responsive > .table-bordered > thead > tr > th:first-child,
.panel > .table-bordered > tbody > tr > th:first-child,
.panel > .table-responsive > .table-bordered > tbody > tr > th:first-child,
.panel > .table-bordered > tfoot > tr > th:first-child,
.panel > .table-responsive > .table-bordered > tfoot > tr > th:first-child,
.panel > .table-bordered > thead > tr > td:first-child,
.panel > .table-responsive > .table-bordered > thead > tr > td:first-child,
.panel > .table-bordered > tbody > tr > td:first-child,
.panel > .table-responsive > .table-bordered > tbody > tr > td:first-child,
.panel > .table-bordered > tfoot > tr > td:first-child,
.panel > .table-responsive > .table-bordered > tfoot > tr > td:first-child {
border-left: 0;
}
.panel > .table-bordered > thead > tr > th:last-child,
.panel > .table-responsive > .table-bordered > thead > tr > th:last-child,
.panel > .table-bordered > tbody > tr > th:last-child,
.panel > .table-responsive > .table-bordered > tbody > tr > th:last-child,
.panel > .table-bordered > tfoot > tr > th:last-child,
.panel > .table-responsive > .table-bordered > tfoot > tr > th:last-child,
.panel > .table-bordered > thead > tr > td:last-child,
.panel > .table-responsive > .table-bordered > thead > tr > td:last-child,
.panel > .table-bordered > tbody > tr > td:last-child,
.panel > .table-responsive > .table-bordered > tbody > tr > td:last-child,
.panel > .table-bordered > tfoot > tr > td:last-child,
.panel > .table-responsive > .table-bordered > tfoot > tr > td:last-child {
border-right: 0;
}
.panel > .table-bordered > thead > tr:first-child > td,
.panel > .table-responsive > .table-bordered > thead > tr:first-child > td,
.panel > .table-bordered > tbody > tr:first-child > td,
.panel > .table-responsive > .table-bordered > tbody > tr:first-child > td,
.panel > .table-bordered > thead > tr:first-child > th,
.panel > .table-responsive > .table-bordered > thead > tr:first-child > th,
.panel > .table-bordered > tbody > tr:first-child > th,
.panel > .table-responsive > .table-bordered > tbody > tr:first-child > th {
border-bottom: 0;
}
.panel > .table-bordered > tbody > tr:last-child > td,
.panel > .table-responsive > .table-bordered > tbody > tr:last-child > td,
.panel > .table-bordered > tfoot > tr:last-child > td,
.panel > .table-responsive > .table-bordered > tfoot > tr:last-child > td,
.panel > .table-bordered > tbody > tr:last-child > th,
.panel > .table-responsive > .table-bordered > tbody > tr:last-child > th,
.panel > .table-bordered > tfoot > tr:last-child > th,
.panel > .table-responsive > .table-bordered > tfoot > tr:last-child > th {
border-bottom: 0;
}
.panel > .table-responsive {
border: 0;
margin-bottom: 0;
}
.panel-group {
margin-bottom: 18px;
}
.panel-group .panel {
margin-bottom: 0;
border-radius: 2px;
}
.panel-group .panel + .panel {
margin-top: 5px;
}
.panel-group .panel-heading {
border-bottom: 0;
}
.panel-group .panel-heading + .panel-collapse > .panel-body,
.panel-group .panel-heading + .panel-collapse > .list-group {
border-top: 1px solid #ddd;
}
.panel-group .panel-footer {
border-top: 0;
}
.panel-group .panel-footer + .panel-collapse .panel-body {
border-bottom: 1px solid #ddd;
}
.panel-default {
border-color: #ddd;
}
.panel-default > .panel-heading {
color: #333333;
background-color: #f5f5f5;
border-color: #ddd;
}
.panel-default > .panel-heading + .panel-collapse > .panel-body {
border-top-color: #ddd;
}
.panel-default > .panel-heading .badge {
color: #f5f5f5;
background-color: #333333;
}
.panel-default > .panel-footer + .panel-collapse > .panel-body {
border-bottom-color: #ddd;
}
.panel-primary {
border-color: #337ab7;
}
.panel-primary > .panel-heading {
color: #fff;
background-color: #337ab7;
border-color: #337ab7;
}
.panel-primary > .panel-heading + .panel-collapse > .panel-body {
border-top-color: #337ab7;
}
.panel-primary > .panel-heading .badge {
color: #337ab7;
background-color: #fff;
}
.panel-primary > .panel-footer + .panel-collapse > .panel-body {
border-bottom-color: #337ab7;
}
.panel-success {
border-color: #d6e9c6;
}
.panel-success > .panel-heading {
color: #3c763d;
background-color: #dff0d8;
border-color: #d6e9c6;
}
.panel-success > .panel-heading + .panel-collapse > .panel-body {
border-top-color: #d6e9c6;
}
.panel-success > .panel-heading .badge {
color: #dff0d8;
background-color: #3c763d;
}
.panel-success > .panel-footer + .panel-collapse > .panel-body {
border-bottom-color: #d6e9c6;
}
.panel-info {
border-color: #bce8f1;
}
.panel-info > .panel-heading {
color: #31708f;
background-color: #d9edf7;
border-color: #bce8f1;
}
.panel-info > .panel-heading + .panel-collapse > .panel-body {
border-top-color: #bce8f1;
}
.panel-info > .panel-heading .badge {
color: #d9edf7;
background-color: #31708f;
}
.panel-info > .panel-footer + .panel-collapse > .panel-body {
border-bottom-color: #bce8f1;
}
.panel-warning {
border-color: #faebcc;
}
.panel-warning > .panel-heading {
color: #8a6d3b;
background-color: #fcf8e3;
border-color: #faebcc;
}
.panel-warning > .panel-heading + .panel-collapse > .panel-body {
border-top-color: #faebcc;
}
.panel-warning > .panel-heading .badge {
color: #fcf8e3;
background-color: #8a6d3b;
}
.panel-warning > .panel-footer + .panel-collapse > .panel-body {
border-bottom-color: #faebcc;
}
.panel-danger {
border-color: #ebccd1;
}
.panel-danger > .panel-heading {
color: #a94442;
background-color: #f2dede;
border-color: #ebccd1;
}
.panel-danger > .panel-heading + .panel-collapse > .panel-body {
border-top-color: #ebccd1;
}
.panel-danger > .panel-heading .badge {
color: #f2dede;
background-color: #a94442;
}
.panel-danger > .panel-footer + .panel-collapse > .panel-body {
border-bottom-color: #ebccd1;
}
.embed-responsive {
position: relative;
display: block;
height: 0;
padding: 0;
overflow: hidden;
}
.embed-responsive .embed-responsive-item,
.embed-responsive iframe,
.embed-responsive embed,
.embed-responsive object,
.embed-responsive video {
position: absolute;
top: 0;
left: 0;
bottom: 0;
height: 100%;
width: 100%;
border: 0;
}
.embed-responsive-16by9 {
padding-bottom: 56.25%;
}
.embed-responsive-4by3 {
padding-bottom: 75%;
}
.well {
min-height: 20px;
padding: 19px;
margin-bottom: 20px;
background-color: #f5f5f5;
border: 1px solid #e3e3e3;
border-radius: 2px;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.05);
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.05);
}
.well blockquote {
border-color: #ddd;
border-color: rgba(0, 0, 0, 0.15);
}
.well-lg {
padding: 24px;
border-radius: 3px;
}
.well-sm {
padding: 9px;
border-radius: 1px;
}
.close {
float: right;
font-size: 19.5px;
font-weight: bold;
line-height: 1;
color: #000;
text-shadow: 0 1px 0 #fff;
opacity: 0.2;
filter: alpha(opacity=20);
}
.close:hover,
.close:focus {
color: #000;
text-decoration: none;
cursor: pointer;
opacity: 0.5;
filter: alpha(opacity=50);
}
button.close {
padding: 0;
cursor: pointer;
background: transparent;
border: 0;
-webkit-appearance: none;
}
.modal-open {
overflow: hidden;
}
.modal {
display: none;
overflow: hidden;
position: fixed;
top: 0;
right: 0;
bottom: 0;
left: 0;
z-index: 1050;
-webkit-overflow-scrolling: touch;
outline: 0;
}
.modal.fade .modal-dialog {
-webkit-transform: translate(0, -25%);
-ms-transform: translate(0, -25%);
-o-transform: translate(0, -25%);
transform: translate(0, -25%);
-webkit-transition: -webkit-transform 0.3s ease-out;
-moz-transition: -moz-transform 0.3s ease-out;
-o-transition: -o-transform 0.3s ease-out;
transition: transform 0.3s ease-out;
}
.modal.in .modal-dialog {
-webkit-transform: translate(0, 0);
-ms-transform: translate(0, 0);
-o-transform: translate(0, 0);
transform: translate(0, 0);
}
.modal-open .modal {
overflow-x: hidden;
overflow-y: auto;
}
.modal-dialog {
position: relative;
width: auto;
margin: 10px;
}
.modal-content {
position: relative;
background-color: #fff;
border: 1px solid #999;
border: 1px solid rgba(0, 0, 0, 0.2);
border-radius: 3px;
-webkit-box-shadow: 0 3px 9px rgba(0, 0, 0, 0.5);
box-shadow: 0 3px 9px rgba(0, 0, 0, 0.5);
background-clip: padding-box;
outline: 0;
}
.modal-backdrop {
position: fixed;
top: 0;
right: 0;
bottom: 0;
left: 0;
z-index: 1040;
background-color: #000;
}
.modal-backdrop.fade {
opacity: 0;
filter: alpha(opacity=0);
}
.modal-backdrop.in {
opacity: 0.5;
filter: alpha(opacity=50);
}
.modal-header {
padding: 15px;
border-bottom: 1px solid #e5e5e5;
}
.modal-header .close {
margin-top: -2px;
}
.modal-title {
margin: 0;
line-height: 1.42857143;
}
.modal-body {
position: relative;
padding: 15px;
}
.modal-footer {
padding: 15px;
text-align: right;
border-top: 1px solid #e5e5e5;
}
.modal-footer .btn + .btn {
margin-left: 5px;
margin-bottom: 0;
}
.modal-footer .btn-group .btn + .btn {
margin-left: -1px;
}
.modal-footer .btn-block + .btn-block {
margin-left: 0;
}
.modal-scrollbar-measure {
position: absolute;
top: -9999px;
width: 50px;
height: 50px;
overflow: scroll;
}
@media (min-width: 768px) {
.modal-dialog {
width: 600px;
margin: 30px auto;
}
.modal-content {
-webkit-box-shadow: 0 5px 15px rgba(0, 0, 0, 0.5);
box-shadow: 0 5px 15px rgba(0, 0, 0, 0.5);
}
.modal-sm {
width: 300px;
}
}
@media (min-width: 992px) {
.modal-lg {
width: 900px;
}
}
.tooltip {
position: absolute;
z-index: 1070;
display: block;
font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
font-style: normal;
font-weight: normal;
letter-spacing: normal;
line-break: auto;
line-height: 1.42857143;
text-align: left;
text-align: start;
text-decoration: none;
text-shadow: none;
text-transform: none;
white-space: normal;
word-break: normal;
word-spacing: normal;
word-wrap: normal;
font-size: 12px;
opacity: 0;
filter: alpha(opacity=0);
}
.tooltip.in {
opacity: 0.9;
filter: alpha(opacity=90);
}
.tooltip.top {
margin-top: -3px;
padding: 5px 0;
}
.tooltip.right {
margin-left: 3px;
padding: 0 5px;
}
.tooltip.bottom {
margin-top: 3px;
padding: 5px 0;
}
.tooltip.left {
margin-left: -3px;
padding: 0 5px;
}
.tooltip-inner {
max-width: 200px;
padding: 3px 8px;
color: #fff;
text-align: center;
background-color: #000;
border-radius: 2px;
}
.tooltip-arrow {
position: absolute;
width: 0;
height: 0;
border-color: transparent;
border-style: solid;
}
.tooltip.top .tooltip-arrow {
bottom: 0;
left: 50%;
margin-left: -5px;
border-width: 5px 5px 0;
border-top-color: #000;
}
.tooltip.top-left .tooltip-arrow {
bottom: 0;
right: 5px;
margin-bottom: -5px;
border-width: 5px 5px 0;
border-top-color: #000;
}
.tooltip.top-right .tooltip-arrow {
bottom: 0;
left: 5px;
margin-bottom: -5px;
border-width: 5px 5px 0;
border-top-color: #000;
}
.tooltip.right .tooltip-arrow {
top: 50%;
left: 0;
margin-top: -5px;
border-width: 5px 5px 5px 0;
border-right-color: #000;
}
.tooltip.left .tooltip-arrow {
top: 50%;
right: 0;
margin-top: -5px;
border-width: 5px 0 5px 5px;
border-left-color: #000;
}
.tooltip.bottom .tooltip-arrow {
top: 0;
left: 50%;
margin-left: -5px;
border-width: 0 5px 5px;
border-bottom-color: #000;
}
.tooltip.bottom-left .tooltip-arrow {
top: 0;
right: 5px;
margin-top: -5px;
border-width: 0 5px 5px;
border-bottom-color: #000;
}
.tooltip.bottom-right .tooltip-arrow {
top: 0;
left: 5px;
margin-top: -5px;
border-width: 0 5px 5px;
border-bottom-color: #000;
}
.popover {
position: absolute;
top: 0;
left: 0;
z-index: 1060;
display: none;
max-width: 276px;
padding: 1px;
font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
font-style: normal;
font-weight: normal;
letter-spacing: normal;
line-break: auto;
line-height: 1.42857143;
text-align: left;
text-align: start;
text-decoration: none;
text-shadow: none;
text-transform: none;
white-space: normal;
word-break: normal;
word-spacing: normal;
word-wrap: normal;
font-size: 13px;
background-color: #fff;
background-clip: padding-box;
border: 1px solid #ccc;
border: 1px solid rgba(0, 0, 0, 0.2);
border-radius: 3px;
-webkit-box-shadow: 0 5px 10px rgba(0, 0, 0, 0.2);
box-shadow: 0 5px 10px rgba(0, 0, 0, 0.2);
}
.popover.top {
margin-top: -10px;
}
.popover.right {
margin-left: 10px;
}
.popover.bottom {
margin-top: 10px;
}
.popover.left {
margin-left: -10px;
}
.popover-title {
margin: 0;
padding: 8px 14px;
font-size: 13px;
background-color: #f7f7f7;
border-bottom: 1px solid #ebebeb;
border-radius: 2px 2px 0 0;
}
.popover-content {
padding: 9px 14px;
}
.popover > .arrow,
.popover > .arrow:after {
position: absolute;
display: block;
width: 0;
height: 0;
border-color: transparent;
border-style: solid;
}
.popover > .arrow {
border-width: 11px;
}
.popover > .arrow:after {
border-width: 10px;
content: "";
}
.popover.top > .arrow {
left: 50%;
margin-left: -11px;
border-bottom-width: 0;
border-top-color: #999999;
border-top-color: rgba(0, 0, 0, 0.25);
bottom: -11px;
}
.popover.top > .arrow:after {
content: " ";
bottom: 1px;
margin-left: -10px;
border-bottom-width: 0;
border-top-color: #fff;
}
.popover.right > .arrow {
top: 50%;
left: -11px;
margin-top: -11px;
border-left-width: 0;
border-right-color: #999999;
border-right-color: rgba(0, 0, 0, 0.25);
}
.popover.right > .arrow:after {
content: " ";
left: 1px;
bottom: -10px;
border-left-width: 0;
border-right-color: #fff;
}
.popover.bottom > .arrow {
left: 50%;
margin-left: -11px;
border-top-width: 0;
border-bottom-color: #999999;
border-bottom-color: rgba(0, 0, 0, 0.25);
top: -11px;
}
.popover.bottom > .arrow:after {
content: " ";
top: 1px;
margin-left: -10px;
border-top-width: 0;
border-bottom-color: #fff;
}
.popover.left > .arrow {
top: 50%;
right: -11px;
margin-top: -11px;
border-right-width: 0;
border-left-color: #999999;
border-left-color: rgba(0, 0, 0, 0.25);
}
.popover.left > .arrow:after {
content: " ";
right: 1px;
border-right-width: 0;
border-left-color: #fff;
bottom: -10px;
}
.carousel {
position: relative;
}
.carousel-inner {
position: relative;
overflow: hidden;
width: 100%;
}
.carousel-inner > .item {
display: none;
position: relative;
-webkit-transition: 0.6s ease-in-out left;
-o-transition: 0.6s ease-in-out left;
transition: 0.6s ease-in-out left;
}
.carousel-inner > .item > img,
.carousel-inner > .item > a > img {
line-height: 1;
}
@media all and (transform-3d), (-webkit-transform-3d) {
.carousel-inner > .item {
-webkit-transition: -webkit-transform 0.6s ease-in-out;
-moz-transition: -moz-transform 0.6s ease-in-out;
-o-transition: -o-transform 0.6s ease-in-out;
transition: transform 0.6s ease-in-out;
-webkit-backface-visibility: hidden;
-moz-backface-visibility: hidden;
backface-visibility: hidden;
-webkit-perspective: 1000px;
-moz-perspective: 1000px;
perspective: 1000px;
}
.carousel-inner > .item.next,
.carousel-inner > .item.active.right {
-webkit-transform: translate3d(100%, 0, 0);
transform: translate3d(100%, 0, 0);
left: 0;
}
.carousel-inner > .item.prev,
.carousel-inner > .item.active.left {
-webkit-transform: translate3d(-100%, 0, 0);
transform: translate3d(-100%, 0, 0);
left: 0;
}
.carousel-inner > .item.next.left,
.carousel-inner > .item.prev.right,
.carousel-inner > .item.active {
-webkit-transform: translate3d(0, 0, 0);
transform: translate3d(0, 0, 0);
left: 0;
}
}
.carousel-inner > .active,
.carousel-inner > .next,
.carousel-inner > .prev {
display: block;
}
.carousel-inner > .active {
left: 0;
}
.carousel-inner > .next,
.carousel-inner > .prev {
position: absolute;
top: 0;
width: 100%;
}
.carousel-inner > .next {
left: 100%;
}
.carousel-inner > .prev {
left: -100%;
}
.carousel-inner > .next.left,
.carousel-inner > .prev.right {
left: 0;
}
.carousel-inner > .active.left {
left: -100%;
}
.carousel-inner > .active.right {
left: 100%;
}
.carousel-control {
position: absolute;
top: 0;
left: 0;
bottom: 0;
width: 15%;
opacity: 0.5;
filter: alpha(opacity=50);
font-size: 20px;
color: #fff;
text-align: center;
text-shadow: 0 1px 2px rgba(0, 0, 0, 0.6);
background-color: rgba(0, 0, 0, 0);
}
.carousel-control.left {
background-image: -webkit-linear-gradient(left, rgba(0, 0, 0, 0.5) 0%, rgba(0, 0, 0, 0.0001) 100%);
background-image: -o-linear-gradient(left, rgba(0, 0, 0, 0.5) 0%, rgba(0, 0, 0, 0.0001) 100%);
background-image: linear-gradient(to right, rgba(0, 0, 0, 0.5) 0%, rgba(0, 0, 0, 0.0001) 100%);
background-repeat: repeat-x;
filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#80000000', endColorstr='#00000000', GradientType=1);
}
.carousel-control.right {
left: auto;
right: 0;
background-image: -webkit-linear-gradient(left, rgba(0, 0, 0, 0.0001) 0%, rgba(0, 0, 0, 0.5) 100%);
background-image: -o-linear-gradient(left, rgba(0, 0, 0, 0.0001) 0%, rgba(0, 0, 0, 0.5) 100%);
background-image: linear-gradient(to right, rgba(0, 0, 0, 0.0001) 0%, rgba(0, 0, 0, 0.5) 100%);
background-repeat: repeat-x;
filter: progid:DXImageTransform.Microsoft.gradient(startColorstr='#00000000', endColorstr='#80000000', GradientType=1);
}
.carousel-control:hover,
.carousel-control:focus {
outline: 0;
color: #fff;
text-decoration: none;
opacity: 0.9;
filter: alpha(opacity=90);
}
.carousel-control .icon-prev,
.carousel-control .icon-next,
.carousel-control .glyphicon-chevron-left,
.carousel-control .glyphicon-chevron-right {
position: absolute;
top: 50%;
margin-top: -10px;
z-index: 5;
display: inline-block;
}
.carousel-control .icon-prev,
.carousel-control .glyphicon-chevron-left {
left: 50%;
margin-left: -10px;
}
.carousel-control .icon-next,
.carousel-control .glyphicon-chevron-right {
right: 50%;
margin-right: -10px;
}
.carousel-control .icon-prev,
.carousel-control .icon-next {
width: 20px;
height: 20px;
line-height: 1;
font-family: serif;
}
.carousel-control .icon-prev:before {
content: '\2039';
}
.carousel-control .icon-next:before {
content: '\203a';
}
.carousel-indicators {
position: absolute;
bottom: 10px;
left: 50%;
z-index: 15;
width: 60%;
margin-left: -30%;
padding-left: 0;
list-style: none;
text-align: center;
}
.carousel-indicators li {
display: inline-block;
width: 10px;
height: 10px;
margin: 1px;
text-indent: -999px;
border: 1px solid #fff;
border-radius: 10px;
cursor: pointer;
background-color: #000 \9;
background-color: rgba(0, 0, 0, 0);
}
.carousel-indicators .active {
margin: 0;
width: 12px;
height: 12px;
background-color: #fff;
}
.carousel-caption {
position: absolute;
left: 15%;
right: 15%;
bottom: 20px;
z-index: 10;
padding-top: 20px;
padding-bottom: 20px;
color: #fff;
text-align: center;
text-shadow: 0 1px 2px rgba(0, 0, 0, 0.6);
}
.carousel-caption .btn {
text-shadow: none;
}
@media screen and (min-width: 768px) {
.carousel-control .glyphicon-chevron-left,
.carousel-control .glyphicon-chevron-right,
.carousel-control .icon-prev,
.carousel-control .icon-next {
width: 30px;
height: 30px;
margin-top: -10px;
font-size: 30px;
}
.carousel-control .glyphicon-chevron-left,
.carousel-control .icon-prev {
margin-left: -10px;
}
.carousel-control .glyphicon-chevron-right,
.carousel-control .icon-next {
margin-right: -10px;
}
.carousel-caption {
left: 20%;
right: 20%;
padding-bottom: 30px;
}
.carousel-indicators {
bottom: 20px;
}
}
.clearfix:before,
.clearfix:after,
.dl-horizontal dd:before,
.dl-horizontal dd:after,
.container:before,
.container:after,
.container-fluid:before,
.container-fluid:after,
.row:before,
.row:after,
.form-horizontal .form-group:before,
.form-horizontal .form-group:after,
.btn-toolbar:before,
.btn-toolbar:after,
.btn-group-vertical > .btn-group:before,
.btn-group-vertical > .btn-group:after,
.nav:before,
.nav:after,
.navbar:before,
.navbar:after,
.navbar-header:before,
.navbar-header:after,
.navbar-collapse:before,
.navbar-collapse:after,
.pager:before,
.pager:after,
.panel-body:before,
.panel-body:after,
.modal-header:before,
.modal-header:after,
.modal-footer:before,
.modal-footer:after,
.item_buttons:before,
.item_buttons:after {
content: " ";
display: table;
}
.clearfix:after,
.dl-horizontal dd:after,
.container:after,
.container-fluid:after,
.row:after,
.form-horizontal .form-group:after,
.btn-toolbar:after,
.btn-group-vertical > .btn-group:after,
.nav:after,
.navbar:after,
.navbar-header:after,
.navbar-collapse:after,
.pager:after,
.panel-body:after,
.modal-header:after,
.modal-footer:after,
.item_buttons:after {
clear: both;
}
.center-block {
display: block;
margin-left: auto;
margin-right: auto;
}
.pull-right {
float: right !important;
}
.pull-left {
float: left !important;
}
.hide {
display: none !important;
}
.show {
display: block !important;
}
.invisible {
visibility: hidden;
}
.text-hide {
font: 0/0 a;
color: transparent;
text-shadow: none;
background-color: transparent;
border: 0;
}
.hidden {
display: none !important;
}
.affix {
position: fixed;
}
@-ms-viewport {
width: device-width;
}
.visible-xs,
.visible-sm,
.visible-md,
.visible-lg {
display: none !important;
}
.visible-xs-block,
.visible-xs-inline,
.visible-xs-inline-block,
.visible-sm-block,
.visible-sm-inline,
.visible-sm-inline-block,
.visible-md-block,
.visible-md-inline,
.visible-md-inline-block,
.visible-lg-block,
.visible-lg-inline,
.visible-lg-inline-block {
display: none !important;
}
@media (max-width: 767px) {
.visible-xs {
display: block !important;
}
table.visible-xs {
display: table !important;
}
tr.visible-xs {
display: table-row !important;
}
th.visible-xs,
td.visible-xs {
display: table-cell !important;
}
}
@media (max-width: 767px) {
.visible-xs-block {
display: block !important;
}
}
@media (max-width: 767px) {
.visible-xs-inline {
display: inline !important;
}
}
@media (max-width: 767px) {
.visible-xs-inline-block {
display: inline-block !important;
}
}
@media (min-width: 768px) and (max-width: 991px) {
.visible-sm {
display: block !important;
}
table.visible-sm {
display: table !important;
}
tr.visible-sm {
display: table-row !important;
}
th.visible-sm,
td.visible-sm {
display: table-cell !important;
}
}
@media (min-width: 768px) and (max-width: 991px) {
.visible-sm-block {
display: block !important;
}
}
@media (min-width: 768px) and (max-width: 991px) {
.visible-sm-inline {
display: inline !important;
}
}
@media (min-width: 768px) and (max-width: 991px) {
.visible-sm-inline-block {
display: inline-block !important;
}
}
@media (min-width: 992px) and (max-width: 1199px) {
.visible-md {
display: block !important;
}
table.visible-md {
display: table !important;
}
tr.visible-md {
display: table-row !important;
}
th.visible-md,
td.visible-md {
display: table-cell !important;
}
}
@media (min-width: 992px) and (max-width: 1199px) {
.visible-md-block {
display: block !important;
}
}
@media (min-width: 992px) and (max-width: 1199px) {
.visible-md-inline {
display: inline !important;
}
}
@media (min-width: 992px) and (max-width: 1199px) {
.visible-md-inline-block {
display: inline-block !important;
}
}
@media (min-width: 1200px) {
.visible-lg {
display: block !important;
}
table.visible-lg {
display: table !important;
}
tr.visible-lg {
display: table-row !important;
}
th.visible-lg,
td.visible-lg {
display: table-cell !important;
}
}
@media (min-width: 1200px) {
.visible-lg-block {
display: block !important;
}
}
@media (min-width: 1200px) {
.visible-lg-inline {
display: inline !important;
}
}
@media (min-width: 1200px) {
.visible-lg-inline-block {
display: inline-block !important;
}
}
@media (max-width: 767px) {
.hidden-xs {
display: none !important;
}
}
@media (min-width: 768px) and (max-width: 991px) {
.hidden-sm {
display: none !important;
}
}
@media (min-width: 992px) and (max-width: 1199px) {
.hidden-md {
display: none !important;
}
}
@media (min-width: 1200px) {
.hidden-lg {
display: none !important;
}
}
.visible-print {
display: none !important;
}
@media print {
.visible-print {
display: block !important;
}
table.visible-print {
display: table !important;
}
tr.visible-print {
display: table-row !important;
}
th.visible-print,
td.visible-print {
display: table-cell !important;
}
}
.visible-print-block {
display: none !important;
}
@media print {
.visible-print-block {
display: block !important;
}
}
.visible-print-inline {
display: none !important;
}
@media print {
.visible-print-inline {
display: inline !important;
}
}
.visible-print-inline-block {
display: none !important;
}
@media print {
.visible-print-inline-block {
display: inline-block !important;
}
}
@media print {
.hidden-print {
display: none !important;
}
}
/*!
*
* Font Awesome
*
*/
/*!
* Font Awesome 4.2.0 by @davegandy - http://fontawesome.io - @fontawesome
* License - http://fontawesome.io/license (Font: SIL OFL 1.1, CSS: MIT License)
*/
/* FONT PATH
* -------------------------- */
@font-face {
font-family: 'FontAwesome';
src: url('../components/font-awesome/fonts/fontawesome-webfont.eot?v=4.2.0');
src: url('../components/font-awesome/fonts/fontawesome-webfont.eot?#iefix&v=4.2.0') format('embedded-opentype'), url('../components/font-awesome/fonts/fontawesome-webfont.woff?v=4.2.0') format('woff'), url('../components/font-awesome/fonts/fontawesome-webfont.ttf?v=4.2.0') format('truetype'), url('../components/font-awesome/fonts/fontawesome-webfont.svg?v=4.2.0#fontawesomeregular') format('svg');
font-weight: normal;
font-style: normal;
}
.fa {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
}
/* makes the font 33% larger relative to the icon container */
.fa-lg {
font-size: 1.33333333em;
line-height: 0.75em;
vertical-align: -15%;
}
.fa-2x {
font-size: 2em;
}
.fa-3x {
font-size: 3em;
}
.fa-4x {
font-size: 4em;
}
.fa-5x {
font-size: 5em;
}
.fa-fw {
width: 1.28571429em;
text-align: center;
}
.fa-ul {
padding-left: 0;
margin-left: 2.14285714em;
list-style-type: none;
}
.fa-ul > li {
position: relative;
}
.fa-li {
position: absolute;
left: -2.14285714em;
width: 2.14285714em;
top: 0.14285714em;
text-align: center;
}
.fa-li.fa-lg {
left: -1.85714286em;
}
.fa-border {
padding: .2em .25em .15em;
border: solid 0.08em #eee;
border-radius: .1em;
}
.pull-right {
float: right;
}
.pull-left {
float: left;
}
.fa.pull-left {
margin-right: .3em;
}
.fa.pull-right {
margin-left: .3em;
}
.fa-spin {
-webkit-animation: fa-spin 2s infinite linear;
animation: fa-spin 2s infinite linear;
}
@-webkit-keyframes fa-spin {
0% {
-webkit-transform: rotate(0deg);
transform: rotate(0deg);
}
100% {
-webkit-transform: rotate(359deg);
transform: rotate(359deg);
}
}
@keyframes fa-spin {
0% {
-webkit-transform: rotate(0deg);
transform: rotate(0deg);
}
100% {
-webkit-transform: rotate(359deg);
transform: rotate(359deg);
}
}
.fa-rotate-90 {
filter: progid:DXImageTransform.Microsoft.BasicImage(rotation=1);
-webkit-transform: rotate(90deg);
-ms-transform: rotate(90deg);
transform: rotate(90deg);
}
.fa-rotate-180 {
filter: progid:DXImageTransform.Microsoft.BasicImage(rotation=2);
-webkit-transform: rotate(180deg);
-ms-transform: rotate(180deg);
transform: rotate(180deg);
}
.fa-rotate-270 {
filter: progid:DXImageTransform.Microsoft.BasicImage(rotation=3);
-webkit-transform: rotate(270deg);
-ms-transform: rotate(270deg);
transform: rotate(270deg);
}
.fa-flip-horizontal {
filter: progid:DXImageTransform.Microsoft.BasicImage(rotation=0, mirror=1);
-webkit-transform: scale(-1, 1);
-ms-transform: scale(-1, 1);
transform: scale(-1, 1);
}
.fa-flip-vertical {
filter: progid:DXImageTransform.Microsoft.BasicImage(rotation=2, mirror=1);
-webkit-transform: scale(1, -1);
-ms-transform: scale(1, -1);
transform: scale(1, -1);
}
:root .fa-rotate-90,
:root .fa-rotate-180,
:root .fa-rotate-270,
:root .fa-flip-horizontal,
:root .fa-flip-vertical {
filter: none;
}
.fa-stack {
position: relative;
display: inline-block;
width: 2em;
height: 2em;
line-height: 2em;
vertical-align: middle;
}
.fa-stack-1x,
.fa-stack-2x {
position: absolute;
left: 0;
width: 100%;
text-align: center;
}
.fa-stack-1x {
line-height: inherit;
}
.fa-stack-2x {
font-size: 2em;
}
.fa-inverse {
color: #fff;
}
/* Font Awesome uses the Unicode Private Use Area (PUA) to ensure screen
readers do not read off random characters that represent icons */
.fa-glass:before {
content: "\f000";
}
.fa-music:before {
content: "\f001";
}
.fa-search:before {
content: "\f002";
}
.fa-envelope-o:before {
content: "\f003";
}
.fa-heart:before {
content: "\f004";
}
.fa-star:before {
content: "\f005";
}
.fa-star-o:before {
content: "\f006";
}
.fa-user:before {
content: "\f007";
}
.fa-film:before {
content: "\f008";
}
.fa-th-large:before {
content: "\f009";
}
.fa-th:before {
content: "\f00a";
}
.fa-th-list:before {
content: "\f00b";
}
.fa-check:before {
content: "\f00c";
}
.fa-remove:before,
.fa-close:before,
.fa-times:before {
content: "\f00d";
}
.fa-search-plus:before {
content: "\f00e";
}
.fa-search-minus:before {
content: "\f010";
}
.fa-power-off:before {
content: "\f011";
}
.fa-signal:before {
content: "\f012";
}
.fa-gear:before,
.fa-cog:before {
content: "\f013";
}
.fa-trash-o:before {
content: "\f014";
}
.fa-home:before {
content: "\f015";
}
.fa-file-o:before {
content: "\f016";
}
.fa-clock-o:before {
content: "\f017";
}
.fa-road:before {
content: "\f018";
}
.fa-download:before {
content: "\f019";
}
.fa-arrow-circle-o-down:before {
content: "\f01a";
}
.fa-arrow-circle-o-up:before {
content: "\f01b";
}
.fa-inbox:before {
content: "\f01c";
}
.fa-play-circle-o:before {
content: "\f01d";
}
.fa-rotate-right:before,
.fa-repeat:before {
content: "\f01e";
}
.fa-refresh:before {
content: "\f021";
}
.fa-list-alt:before {
content: "\f022";
}
.fa-lock:before {
content: "\f023";
}
.fa-flag:before {
content: "\f024";
}
.fa-headphones:before {
content: "\f025";
}
.fa-volume-off:before {
content: "\f026";
}
.fa-volume-down:before {
content: "\f027";
}
.fa-volume-up:before {
content: "\f028";
}
.fa-qrcode:before {
content: "\f029";
}
.fa-barcode:before {
content: "\f02a";
}
.fa-tag:before {
content: "\f02b";
}
.fa-tags:before {
content: "\f02c";
}
.fa-book:before {
content: "\f02d";
}
.fa-bookmark:before {
content: "\f02e";
}
.fa-print:before {
content: "\f02f";
}
.fa-camera:before {
content: "\f030";
}
.fa-font:before {
content: "\f031";
}
.fa-bold:before {
content: "\f032";
}
.fa-italic:before {
content: "\f033";
}
.fa-text-height:before {
content: "\f034";
}
.fa-text-width:before {
content: "\f035";
}
.fa-align-left:before {
content: "\f036";
}
.fa-align-center:before {
content: "\f037";
}
.fa-align-right:before {
content: "\f038";
}
.fa-align-justify:before {
content: "\f039";
}
.fa-list:before {
content: "\f03a";
}
.fa-dedent:before,
.fa-outdent:before {
content: "\f03b";
}
.fa-indent:before {
content: "\f03c";
}
.fa-video-camera:before {
content: "\f03d";
}
.fa-photo:before,
.fa-image:before,
.fa-picture-o:before {
content: "\f03e";
}
.fa-pencil:before {
content: "\f040";
}
.fa-map-marker:before {
content: "\f041";
}
.fa-adjust:before {
content: "\f042";
}
.fa-tint:before {
content: "\f043";
}
.fa-edit:before,
.fa-pencil-square-o:before {
content: "\f044";
}
.fa-share-square-o:before {
content: "\f045";
}
.fa-check-square-o:before {
content: "\f046";
}
.fa-arrows:before {
content: "\f047";
}
.fa-step-backward:before {
content: "\f048";
}
.fa-fast-backward:before {
content: "\f049";
}
.fa-backward:before {
content: "\f04a";
}
.fa-play:before {
content: "\f04b";
}
.fa-pause:before {
content: "\f04c";
}
.fa-stop:before {
content: "\f04d";
}
.fa-forward:before {
content: "\f04e";
}
.fa-fast-forward:before {
content: "\f050";
}
.fa-step-forward:before {
content: "\f051";
}
.fa-eject:before {
content: "\f052";
}
.fa-chevron-left:before {
content: "\f053";
}
.fa-chevron-right:before {
content: "\f054";
}
.fa-plus-circle:before {
content: "\f055";
}
.fa-minus-circle:before {
content: "\f056";
}
.fa-times-circle:before {
content: "\f057";
}
.fa-check-circle:before {
content: "\f058";
}
.fa-question-circle:before {
content: "\f059";
}
.fa-info-circle:before {
content: "\f05a";
}
.fa-crosshairs:before {
content: "\f05b";
}
.fa-times-circle-o:before {
content: "\f05c";
}
.fa-check-circle-o:before {
content: "\f05d";
}
.fa-ban:before {
content: "\f05e";
}
.fa-arrow-left:before {
content: "\f060";
}
.fa-arrow-right:before {
content: "\f061";
}
.fa-arrow-up:before {
content: "\f062";
}
.fa-arrow-down:before {
content: "\f063";
}
.fa-mail-forward:before,
.fa-share:before {
content: "\f064";
}
.fa-expand:before {
content: "\f065";
}
.fa-compress:before {
content: "\f066";
}
.fa-plus:before {
content: "\f067";
}
.fa-minus:before {
content: "\f068";
}
.fa-asterisk:before {
content: "\f069";
}
.fa-exclamation-circle:before {
content: "\f06a";
}
.fa-gift:before {
content: "\f06b";
}
.fa-leaf:before {
content: "\f06c";
}
.fa-fire:before {
content: "\f06d";
}
.fa-eye:before {
content: "\f06e";
}
.fa-eye-slash:before {
content: "\f070";
}
.fa-warning:before,
.fa-exclamation-triangle:before {
content: "\f071";
}
.fa-plane:before {
content: "\f072";
}
.fa-calendar:before {
content: "\f073";
}
.fa-random:before {
content: "\f074";
}
.fa-comment:before {
content: "\f075";
}
.fa-magnet:before {
content: "\f076";
}
.fa-chevron-up:before {
content: "\f077";
}
.fa-chevron-down:before {
content: "\f078";
}
.fa-retweet:before {
content: "\f079";
}
.fa-shopping-cart:before {
content: "\f07a";
}
.fa-folder:before {
content: "\f07b";
}
.fa-folder-open:before {
content: "\f07c";
}
.fa-arrows-v:before {
content: "\f07d";
}
.fa-arrows-h:before {
content: "\f07e";
}
.fa-bar-chart-o:before,
.fa-bar-chart:before {
content: "\f080";
}
.fa-twitter-square:before {
content: "\f081";
}
.fa-facebook-square:before {
content: "\f082";
}
.fa-camera-retro:before {
content: "\f083";
}
.fa-key:before {
content: "\f084";
}
.fa-gears:before,
.fa-cogs:before {
content: "\f085";
}
.fa-comments:before {
content: "\f086";
}
.fa-thumbs-o-up:before {
content: "\f087";
}
.fa-thumbs-o-down:before {
content: "\f088";
}
.fa-star-half:before {
content: "\f089";
}
.fa-heart-o:before {
content: "\f08a";
}
.fa-sign-out:before {
content: "\f08b";
}
.fa-linkedin-square:before {
content: "\f08c";
}
.fa-thumb-tack:before {
content: "\f08d";
}
.fa-external-link:before {
content: "\f08e";
}
.fa-sign-in:before {
content: "\f090";
}
.fa-trophy:before {
content: "\f091";
}
.fa-github-square:before {
content: "\f092";
}
.fa-upload:before {
content: "\f093";
}
.fa-lemon-o:before {
content: "\f094";
}
.fa-phone:before {
content: "\f095";
}
.fa-square-o:before {
content: "\f096";
}
.fa-bookmark-o:before {
content: "\f097";
}
.fa-phone-square:before {
content: "\f098";
}
.fa-twitter:before {
content: "\f099";
}
.fa-facebook:before {
content: "\f09a";
}
.fa-github:before {
content: "\f09b";
}
.fa-unlock:before {
content: "\f09c";
}
.fa-credit-card:before {
content: "\f09d";
}
.fa-rss:before {
content: "\f09e";
}
.fa-hdd-o:before {
content: "\f0a0";
}
.fa-bullhorn:before {
content: "\f0a1";
}
.fa-bell:before {
content: "\f0f3";
}
.fa-certificate:before {
content: "\f0a3";
}
.fa-hand-o-right:before {
content: "\f0a4";
}
.fa-hand-o-left:before {
content: "\f0a5";
}
.fa-hand-o-up:before {
content: "\f0a6";
}
.fa-hand-o-down:before {
content: "\f0a7";
}
.fa-arrow-circle-left:before {
content: "\f0a8";
}
.fa-arrow-circle-right:before {
content: "\f0a9";
}
.fa-arrow-circle-up:before {
content: "\f0aa";
}
.fa-arrow-circle-down:before {
content: "\f0ab";
}
.fa-globe:before {
content: "\f0ac";
}
.fa-wrench:before {
content: "\f0ad";
}
.fa-tasks:before {
content: "\f0ae";
}
.fa-filter:before {
content: "\f0b0";
}
.fa-briefcase:before {
content: "\f0b1";
}
.fa-arrows-alt:before {
content: "\f0b2";
}
.fa-group:before,
.fa-users:before {
content: "\f0c0";
}
.fa-chain:before,
.fa-link:before {
content: "\f0c1";
}
.fa-cloud:before {
content: "\f0c2";
}
.fa-flask:before {
content: "\f0c3";
}
.fa-cut:before,
.fa-scissors:before {
content: "\f0c4";
}
.fa-copy:before,
.fa-files-o:before {
content: "\f0c5";
}
.fa-paperclip:before {
content: "\f0c6";
}
.fa-save:before,
.fa-floppy-o:before {
content: "\f0c7";
}
.fa-square:before {
content: "\f0c8";
}
.fa-navicon:before,
.fa-reorder:before,
.fa-bars:before {
content: "\f0c9";
}
.fa-list-ul:before {
content: "\f0ca";
}
.fa-list-ol:before {
content: "\f0cb";
}
.fa-strikethrough:before {
content: "\f0cc";
}
.fa-underline:before {
content: "\f0cd";
}
.fa-table:before {
content: "\f0ce";
}
.fa-magic:before {
content: "\f0d0";
}
.fa-truck:before {
content: "\f0d1";
}
.fa-pinterest:before {
content: "\f0d2";
}
.fa-pinterest-square:before {
content: "\f0d3";
}
.fa-google-plus-square:before {
content: "\f0d4";
}
.fa-google-plus:before {
content: "\f0d5";
}
.fa-money:before {
content: "\f0d6";
}
.fa-caret-down:before {
content: "\f0d7";
}
.fa-caret-up:before {
content: "\f0d8";
}
.fa-caret-left:before {
content: "\f0d9";
}
.fa-caret-right:before {
content: "\f0da";
}
.fa-columns:before {
content: "\f0db";
}
.fa-unsorted:before,
.fa-sort:before {
content: "\f0dc";
}
.fa-sort-down:before,
.fa-sort-desc:before {
content: "\f0dd";
}
.fa-sort-up:before,
.fa-sort-asc:before {
content: "\f0de";
}
.fa-envelope:before {
content: "\f0e0";
}
.fa-linkedin:before {
content: "\f0e1";
}
.fa-rotate-left:before,
.fa-undo:before {
content: "\f0e2";
}
.fa-legal:before,
.fa-gavel:before {
content: "\f0e3";
}
.fa-dashboard:before,
.fa-tachometer:before {
content: "\f0e4";
}
.fa-comment-o:before {
content: "\f0e5";
}
.fa-comments-o:before {
content: "\f0e6";
}
.fa-flash:before,
.fa-bolt:before {
content: "\f0e7";
}
.fa-sitemap:before {
content: "\f0e8";
}
.fa-umbrella:before {
content: "\f0e9";
}
.fa-paste:before,
.fa-clipboard:before {
content: "\f0ea";
}
.fa-lightbulb-o:before {
content: "\f0eb";
}
.fa-exchange:before {
content: "\f0ec";
}
.fa-cloud-download:before {
content: "\f0ed";
}
.fa-cloud-upload:before {
content: "\f0ee";
}
.fa-user-md:before {
content: "\f0f0";
}
.fa-stethoscope:before {
content: "\f0f1";
}
.fa-suitcase:before {
content: "\f0f2";
}
.fa-bell-o:before {
content: "\f0a2";
}
.fa-coffee:before {
content: "\f0f4";
}
.fa-cutlery:before {
content: "\f0f5";
}
.fa-file-text-o:before {
content: "\f0f6";
}
.fa-building-o:before {
content: "\f0f7";
}
.fa-hospital-o:before {
content: "\f0f8";
}
.fa-ambulance:before {
content: "\f0f9";
}
.fa-medkit:before {
content: "\f0fa";
}
.fa-fighter-jet:before {
content: "\f0fb";
}
.fa-beer:before {
content: "\f0fc";
}
.fa-h-square:before {
content: "\f0fd";
}
.fa-plus-square:before {
content: "\f0fe";
}
.fa-angle-double-left:before {
content: "\f100";
}
.fa-angle-double-right:before {
content: "\f101";
}
.fa-angle-double-up:before {
content: "\f102";
}
.fa-angle-double-down:before {
content: "\f103";
}
.fa-angle-left:before {
content: "\f104";
}
.fa-angle-right:before {
content: "\f105";
}
.fa-angle-up:before {
content: "\f106";
}
.fa-angle-down:before {
content: "\f107";
}
.fa-desktop:before {
content: "\f108";
}
.fa-laptop:before {
content: "\f109";
}
.fa-tablet:before {
content: "\f10a";
}
.fa-mobile-phone:before,
.fa-mobile:before {
content: "\f10b";
}
.fa-circle-o:before {
content: "\f10c";
}
.fa-quote-left:before {
content: "\f10d";
}
.fa-quote-right:before {
content: "\f10e";
}
.fa-spinner:before {
content: "\f110";
}
.fa-circle:before {
content: "\f111";
}
.fa-mail-reply:before,
.fa-reply:before {
content: "\f112";
}
.fa-github-alt:before {
content: "\f113";
}
.fa-folder-o:before {
content: "\f114";
}
.fa-folder-open-o:before {
content: "\f115";
}
.fa-smile-o:before {
content: "\f118";
}
.fa-frown-o:before {
content: "\f119";
}
.fa-meh-o:before {
content: "\f11a";
}
.fa-gamepad:before {
content: "\f11b";
}
.fa-keyboard-o:before {
content: "\f11c";
}
.fa-flag-o:before {
content: "\f11d";
}
.fa-flag-checkered:before {
content: "\f11e";
}
.fa-terminal:before {
content: "\f120";
}
.fa-code:before {
content: "\f121";
}
.fa-mail-reply-all:before,
.fa-reply-all:before {
content: "\f122";
}
.fa-star-half-empty:before,
.fa-star-half-full:before,
.fa-star-half-o:before {
content: "\f123";
}
.fa-location-arrow:before {
content: "\f124";
}
.fa-crop:before {
content: "\f125";
}
.fa-code-fork:before {
content: "\f126";
}
.fa-unlink:before,
.fa-chain-broken:before {
content: "\f127";
}
.fa-question:before {
content: "\f128";
}
.fa-info:before {
content: "\f129";
}
.fa-exclamation:before {
content: "\f12a";
}
.fa-superscript:before {
content: "\f12b";
}
.fa-subscript:before {
content: "\f12c";
}
.fa-eraser:before {
content: "\f12d";
}
.fa-puzzle-piece:before {
content: "\f12e";
}
.fa-microphone:before {
content: "\f130";
}
.fa-microphone-slash:before {
content: "\f131";
}
.fa-shield:before {
content: "\f132";
}
.fa-calendar-o:before {
content: "\f133";
}
.fa-fire-extinguisher:before {
content: "\f134";
}
.fa-rocket:before {
content: "\f135";
}
.fa-maxcdn:before {
content: "\f136";
}
.fa-chevron-circle-left:before {
content: "\f137";
}
.fa-chevron-circle-right:before {
content: "\f138";
}
.fa-chevron-circle-up:before {
content: "\f139";
}
.fa-chevron-circle-down:before {
content: "\f13a";
}
.fa-html5:before {
content: "\f13b";
}
.fa-css3:before {
content: "\f13c";
}
.fa-anchor:before {
content: "\f13d";
}
.fa-unlock-alt:before {
content: "\f13e";
}
.fa-bullseye:before {
content: "\f140";
}
.fa-ellipsis-h:before {
content: "\f141";
}
.fa-ellipsis-v:before {
content: "\f142";
}
.fa-rss-square:before {
content: "\f143";
}
.fa-play-circle:before {
content: "\f144";
}
.fa-ticket:before {
content: "\f145";
}
.fa-minus-square:before {
content: "\f146";
}
.fa-minus-square-o:before {
content: "\f147";
}
.fa-level-up:before {
content: "\f148";
}
.fa-level-down:before {
content: "\f149";
}
.fa-check-square:before {
content: "\f14a";
}
.fa-pencil-square:before {
content: "\f14b";
}
.fa-external-link-square:before {
content: "\f14c";
}
.fa-share-square:before {
content: "\f14d";
}
.fa-compass:before {
content: "\f14e";
}
.fa-toggle-down:before,
.fa-caret-square-o-down:before {
content: "\f150";
}
.fa-toggle-up:before,
.fa-caret-square-o-up:before {
content: "\f151";
}
.fa-toggle-right:before,
.fa-caret-square-o-right:before {
content: "\f152";
}
.fa-euro:before,
.fa-eur:before {
content: "\f153";
}
.fa-gbp:before {
content: "\f154";
}
.fa-dollar:before,
.fa-usd:before {
content: "\f155";
}
.fa-rupee:before,
.fa-inr:before {
content: "\f156";
}
.fa-cny:before,
.fa-rmb:before,
.fa-yen:before,
.fa-jpy:before {
content: "\f157";
}
.fa-ruble:before,
.fa-rouble:before,
.fa-rub:before {
content: "\f158";
}
.fa-won:before,
.fa-krw:before {
content: "\f159";
}
.fa-bitcoin:before,
.fa-btc:before {
content: "\f15a";
}
.fa-file:before {
content: "\f15b";
}
.fa-file-text:before {
content: "\f15c";
}
.fa-sort-alpha-asc:before {
content: "\f15d";
}
.fa-sort-alpha-desc:before {
content: "\f15e";
}
.fa-sort-amount-asc:before {
content: "\f160";
}
.fa-sort-amount-desc:before {
content: "\f161";
}
.fa-sort-numeric-asc:before {
content: "\f162";
}
.fa-sort-numeric-desc:before {
content: "\f163";
}
.fa-thumbs-up:before {
content: "\f164";
}
.fa-thumbs-down:before {
content: "\f165";
}
.fa-youtube-square:before {
content: "\f166";
}
.fa-youtube:before {
content: "\f167";
}
.fa-xing:before {
content: "\f168";
}
.fa-xing-square:before {
content: "\f169";
}
.fa-youtube-play:before {
content: "\f16a";
}
.fa-dropbox:before {
content: "\f16b";
}
.fa-stack-overflow:before {
content: "\f16c";
}
.fa-instagram:before {
content: "\f16d";
}
.fa-flickr:before {
content: "\f16e";
}
.fa-adn:before {
content: "\f170";
}
.fa-bitbucket:before {
content: "\f171";
}
.fa-bitbucket-square:before {
content: "\f172";
}
.fa-tumblr:before {
content: "\f173";
}
.fa-tumblr-square:before {
content: "\f174";
}
.fa-long-arrow-down:before {
content: "\f175";
}
.fa-long-arrow-up:before {
content: "\f176";
}
.fa-long-arrow-left:before {
content: "\f177";
}
.fa-long-arrow-right:before {
content: "\f178";
}
.fa-apple:before {
content: "\f179";
}
.fa-windows:before {
content: "\f17a";
}
.fa-android:before {
content: "\f17b";
}
.fa-linux:before {
content: "\f17c";
}
.fa-dribbble:before {
content: "\f17d";
}
.fa-skype:before {
content: "\f17e";
}
.fa-foursquare:before {
content: "\f180";
}
.fa-trello:before {
content: "\f181";
}
.fa-female:before {
content: "\f182";
}
.fa-male:before {
content: "\f183";
}
.fa-gittip:before {
content: "\f184";
}
.fa-sun-o:before {
content: "\f185";
}
.fa-moon-o:before {
content: "\f186";
}
.fa-archive:before {
content: "\f187";
}
.fa-bug:before {
content: "\f188";
}
.fa-vk:before {
content: "\f189";
}
.fa-weibo:before {
content: "\f18a";
}
.fa-renren:before {
content: "\f18b";
}
.fa-pagelines:before {
content: "\f18c";
}
.fa-stack-exchange:before {
content: "\f18d";
}
.fa-arrow-circle-o-right:before {
content: "\f18e";
}
.fa-arrow-circle-o-left:before {
content: "\f190";
}
.fa-toggle-left:before,
.fa-caret-square-o-left:before {
content: "\f191";
}
.fa-dot-circle-o:before {
content: "\f192";
}
.fa-wheelchair:before {
content: "\f193";
}
.fa-vimeo-square:before {
content: "\f194";
}
.fa-turkish-lira:before,
.fa-try:before {
content: "\f195";
}
.fa-plus-square-o:before {
content: "\f196";
}
.fa-space-shuttle:before {
content: "\f197";
}
.fa-slack:before {
content: "\f198";
}
.fa-envelope-square:before {
content: "\f199";
}
.fa-wordpress:before {
content: "\f19a";
}
.fa-openid:before {
content: "\f19b";
}
.fa-institution:before,
.fa-bank:before,
.fa-university:before {
content: "\f19c";
}
.fa-mortar-board:before,
.fa-graduation-cap:before {
content: "\f19d";
}
.fa-yahoo:before {
content: "\f19e";
}
.fa-google:before {
content: "\f1a0";
}
.fa-reddit:before {
content: "\f1a1";
}
.fa-reddit-square:before {
content: "\f1a2";
}
.fa-stumbleupon-circle:before {
content: "\f1a3";
}
.fa-stumbleupon:before {
content: "\f1a4";
}
.fa-delicious:before {
content: "\f1a5";
}
.fa-digg:before {
content: "\f1a6";
}
.fa-pied-piper:before {
content: "\f1a7";
}
.fa-pied-piper-alt:before {
content: "\f1a8";
}
.fa-drupal:before {
content: "\f1a9";
}
.fa-joomla:before {
content: "\f1aa";
}
.fa-language:before {
content: "\f1ab";
}
.fa-fax:before {
content: "\f1ac";
}
.fa-building:before {
content: "\f1ad";
}
.fa-child:before {
content: "\f1ae";
}
.fa-paw:before {
content: "\f1b0";
}
.fa-spoon:before {
content: "\f1b1";
}
.fa-cube:before {
content: "\f1b2";
}
.fa-cubes:before {
content: "\f1b3";
}
.fa-behance:before {
content: "\f1b4";
}
.fa-behance-square:before {
content: "\f1b5";
}
.fa-steam:before {
content: "\f1b6";
}
.fa-steam-square:before {
content: "\f1b7";
}
.fa-recycle:before {
content: "\f1b8";
}
.fa-automobile:before,
.fa-car:before {
content: "\f1b9";
}
.fa-cab:before,
.fa-taxi:before {
content: "\f1ba";
}
.fa-tree:before {
content: "\f1bb";
}
.fa-spotify:before {
content: "\f1bc";
}
.fa-deviantart:before {
content: "\f1bd";
}
.fa-soundcloud:before {
content: "\f1be";
}
.fa-database:before {
content: "\f1c0";
}
.fa-file-pdf-o:before {
content: "\f1c1";
}
.fa-file-word-o:before {
content: "\f1c2";
}
.fa-file-excel-o:before {
content: "\f1c3";
}
.fa-file-powerpoint-o:before {
content: "\f1c4";
}
.fa-file-photo-o:before,
.fa-file-picture-o:before,
.fa-file-image-o:before {
content: "\f1c5";
}
.fa-file-zip-o:before,
.fa-file-archive-o:before {
content: "\f1c6";
}
.fa-file-sound-o:before,
.fa-file-audio-o:before {
content: "\f1c7";
}
.fa-file-movie-o:before,
.fa-file-video-o:before {
content: "\f1c8";
}
.fa-file-code-o:before {
content: "\f1c9";
}
.fa-vine:before {
content: "\f1ca";
}
.fa-codepen:before {
content: "\f1cb";
}
.fa-jsfiddle:before {
content: "\f1cc";
}
.fa-life-bouy:before,
.fa-life-buoy:before,
.fa-life-saver:before,
.fa-support:before,
.fa-life-ring:before {
content: "\f1cd";
}
.fa-circle-o-notch:before {
content: "\f1ce";
}
.fa-ra:before,
.fa-rebel:before {
content: "\f1d0";
}
.fa-ge:before,
.fa-empire:before {
content: "\f1d1";
}
.fa-git-square:before {
content: "\f1d2";
}
.fa-git:before {
content: "\f1d3";
}
.fa-hacker-news:before {
content: "\f1d4";
}
.fa-tencent-weibo:before {
content: "\f1d5";
}
.fa-qq:before {
content: "\f1d6";
}
.fa-wechat:before,
.fa-weixin:before {
content: "\f1d7";
}
.fa-send:before,
.fa-paper-plane:before {
content: "\f1d8";
}
.fa-send-o:before,
.fa-paper-plane-o:before {
content: "\f1d9";
}
.fa-history:before {
content: "\f1da";
}
.fa-circle-thin:before {
content: "\f1db";
}
.fa-header:before {
content: "\f1dc";
}
.fa-paragraph:before {
content: "\f1dd";
}
.fa-sliders:before {
content: "\f1de";
}
.fa-share-alt:before {
content: "\f1e0";
}
.fa-share-alt-square:before {
content: "\f1e1";
}
.fa-bomb:before {
content: "\f1e2";
}
.fa-soccer-ball-o:before,
.fa-futbol-o:before {
content: "\f1e3";
}
.fa-tty:before {
content: "\f1e4";
}
.fa-binoculars:before {
content: "\f1e5";
}
.fa-plug:before {
content: "\f1e6";
}
.fa-slideshare:before {
content: "\f1e7";
}
.fa-twitch:before {
content: "\f1e8";
}
.fa-yelp:before {
content: "\f1e9";
}
.fa-newspaper-o:before {
content: "\f1ea";
}
.fa-wifi:before {
content: "\f1eb";
}
.fa-calculator:before {
content: "\f1ec";
}
.fa-paypal:before {
content: "\f1ed";
}
.fa-google-wallet:before {
content: "\f1ee";
}
.fa-cc-visa:before {
content: "\f1f0";
}
.fa-cc-mastercard:before {
content: "\f1f1";
}
.fa-cc-discover:before {
content: "\f1f2";
}
.fa-cc-amex:before {
content: "\f1f3";
}
.fa-cc-paypal:before {
content: "\f1f4";
}
.fa-cc-stripe:before {
content: "\f1f5";
}
.fa-bell-slash:before {
content: "\f1f6";
}
.fa-bell-slash-o:before {
content: "\f1f7";
}
.fa-trash:before {
content: "\f1f8";
}
.fa-copyright:before {
content: "\f1f9";
}
.fa-at:before {
content: "\f1fa";
}
.fa-eyedropper:before {
content: "\f1fb";
}
.fa-paint-brush:before {
content: "\f1fc";
}
.fa-birthday-cake:before {
content: "\f1fd";
}
.fa-area-chart:before {
content: "\f1fe";
}
.fa-pie-chart:before {
content: "\f200";
}
.fa-line-chart:before {
content: "\f201";
}
.fa-lastfm:before {
content: "\f202";
}
.fa-lastfm-square:before {
content: "\f203";
}
.fa-toggle-off:before {
content: "\f204";
}
.fa-toggle-on:before {
content: "\f205";
}
.fa-bicycle:before {
content: "\f206";
}
.fa-bus:before {
content: "\f207";
}
.fa-ioxhost:before {
content: "\f208";
}
.fa-angellist:before {
content: "\f209";
}
.fa-cc:before {
content: "\f20a";
}
.fa-shekel:before,
.fa-sheqel:before,
.fa-ils:before {
content: "\f20b";
}
.fa-meanpath:before {
content: "\f20c";
}
/*!
*
* IPython base
*
*/
.modal.fade .modal-dialog {
-webkit-transform: translate(0, 0);
-ms-transform: translate(0, 0);
-o-transform: translate(0, 0);
transform: translate(0, 0);
}
code {
color: #000;
}
pre {
font-size: inherit;
line-height: inherit;
}
label {
font-weight: normal;
}
/* Make the page background atleast 100% the height of the view port */
/* Make the page itself atleast 70% the height of the view port */
.border-box-sizing {
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
}
.corner-all {
border-radius: 2px;
}
.no-padding {
padding: 0px;
}
/* Flexible box model classes */
/* Taken from Alex Russell http://infrequently.org/2009/08/css-3-progress/ */
/* This file is a compatability layer. It allows the usage of flexible box
model layouts accross multiple browsers, including older browsers. The newest,
universal implementation of the flexible box model is used when available (see
`Modern browsers` comments below). Browsers that are known to implement this
new spec completely include:
Firefox 28.0+
Chrome 29.0+
Internet Explorer 11+
Opera 17.0+
Browsers not listed, including Safari, are supported via the styling under the
`Old browsers` comments below.
*/
.hbox {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: horizontal;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: horizontal;
-moz-box-align: stretch;
display: box;
box-orient: horizontal;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: row;
align-items: stretch;
}
.hbox > * {
/* Old browsers */
-webkit-box-flex: 0;
-moz-box-flex: 0;
box-flex: 0;
/* Modern browsers */
flex: none;
}
.vbox {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
}
.vbox > * {
/* Old browsers */
-webkit-box-flex: 0;
-moz-box-flex: 0;
box-flex: 0;
/* Modern browsers */
flex: none;
}
.hbox.reverse,
.vbox.reverse,
.reverse {
/* Old browsers */
-webkit-box-direction: reverse;
-moz-box-direction: reverse;
box-direction: reverse;
/* Modern browsers */
flex-direction: row-reverse;
}
.hbox.box-flex0,
.vbox.box-flex0,
.box-flex0 {
/* Old browsers */
-webkit-box-flex: 0;
-moz-box-flex: 0;
box-flex: 0;
/* Modern browsers */
flex: none;
width: auto;
}
.hbox.box-flex1,
.vbox.box-flex1,
.box-flex1 {
/* Old browsers */
-webkit-box-flex: 1;
-moz-box-flex: 1;
box-flex: 1;
/* Modern browsers */
flex: 1;
}
.hbox.box-flex,
.vbox.box-flex,
.box-flex {
/* Old browsers */
/* Old browsers */
-webkit-box-flex: 1;
-moz-box-flex: 1;
box-flex: 1;
/* Modern browsers */
flex: 1;
}
.hbox.box-flex2,
.vbox.box-flex2,
.box-flex2 {
/* Old browsers */
-webkit-box-flex: 2;
-moz-box-flex: 2;
box-flex: 2;
/* Modern browsers */
flex: 2;
}
.box-group1 {
/* Deprecated */
-webkit-box-flex-group: 1;
-moz-box-flex-group: 1;
box-flex-group: 1;
}
.box-group2 {
/* Deprecated */
-webkit-box-flex-group: 2;
-moz-box-flex-group: 2;
box-flex-group: 2;
}
.hbox.start,
.vbox.start,
.start {
/* Old browsers */
-webkit-box-pack: start;
-moz-box-pack: start;
box-pack: start;
/* Modern browsers */
justify-content: flex-start;
}
.hbox.end,
.vbox.end,
.end {
/* Old browsers */
-webkit-box-pack: end;
-moz-box-pack: end;
box-pack: end;
/* Modern browsers */
justify-content: flex-end;
}
.hbox.center,
.vbox.center,
.center {
/* Old browsers */
-webkit-box-pack: center;
-moz-box-pack: center;
box-pack: center;
/* Modern browsers */
justify-content: center;
}
.hbox.baseline,
.vbox.baseline,
.baseline {
/* Old browsers */
-webkit-box-pack: baseline;
-moz-box-pack: baseline;
box-pack: baseline;
/* Modern browsers */
justify-content: baseline;
}
.hbox.stretch,
.vbox.stretch,
.stretch {
/* Old browsers */
-webkit-box-pack: stretch;
-moz-box-pack: stretch;
box-pack: stretch;
/* Modern browsers */
justify-content: stretch;
}
.hbox.align-start,
.vbox.align-start,
.align-start {
/* Old browsers */
-webkit-box-align: start;
-moz-box-align: start;
box-align: start;
/* Modern browsers */
align-items: flex-start;
}
.hbox.align-end,
.vbox.align-end,
.align-end {
/* Old browsers */
-webkit-box-align: end;
-moz-box-align: end;
box-align: end;
/* Modern browsers */
align-items: flex-end;
}
.hbox.align-center,
.vbox.align-center,
.align-center {
/* Old browsers */
-webkit-box-align: center;
-moz-box-align: center;
box-align: center;
/* Modern browsers */
align-items: center;
}
.hbox.align-baseline,
.vbox.align-baseline,
.align-baseline {
/* Old browsers */
-webkit-box-align: baseline;
-moz-box-align: baseline;
box-align: baseline;
/* Modern browsers */
align-items: baseline;
}
.hbox.align-stretch,
.vbox.align-stretch,
.align-stretch {
/* Old browsers */
-webkit-box-align: stretch;
-moz-box-align: stretch;
box-align: stretch;
/* Modern browsers */
align-items: stretch;
}
div.error {
margin: 2em;
text-align: center;
}
div.error > h1 {
font-size: 500%;
line-height: normal;
}
div.error > p {
font-size: 200%;
line-height: normal;
}
div.traceback-wrapper {
text-align: left;
max-width: 800px;
margin: auto;
}
/**
* Primary styles
*
* Author: Jupyter Development Team
*/
body {
background-color: #fff;
/* This makes sure that the body covers the entire window and needs to
be in a different element than the display: box in wrapper below */
position: absolute;
left: 0px;
right: 0px;
top: 0px;
bottom: 0px;
overflow: visible;
}
body > #header {
/* Initially hidden to prevent FLOUC */
display: none;
background-color: #fff;
/* Display over codemirror */
position: relative;
z-index: 100;
}
body > #header #header-container {
padding-bottom: 5px;
padding-top: 5px;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
}
body > #header .header-bar {
width: 100%;
height: 1px;
background: #e7e7e7;
margin-bottom: -1px;
}
@media print {
body > #header {
display: none !important;
}
}
#header-spacer {
width: 100%;
visibility: hidden;
}
@media print {
#header-spacer {
display: none;
}
}
#ipython_notebook {
padding-left: 0px;
padding-top: 1px;
padding-bottom: 1px;
}
@media (max-width: 991px) {
#ipython_notebook {
margin-left: 10px;
}
}
[dir="rtl"] #ipython_notebook {
float: right !important;
}
#noscript {
width: auto;
padding-top: 16px;
padding-bottom: 16px;
text-align: center;
font-size: 22px;
color: red;
font-weight: bold;
}
#ipython_notebook img {
height: 28px;
}
#site {
width: 100%;
display: none;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
overflow: auto;
}
@media print {
#site {
height: auto !important;
}
}
/* Smaller buttons */
.ui-button .ui-button-text {
padding: 0.2em 0.8em;
font-size: 77%;
}
input.ui-button {
padding: 0.3em 0.9em;
}
span#login_widget {
float: right;
}
span#login_widget > .button,
#logout {
color: #333;
background-color: #fff;
border-color: #ccc;
}
span#login_widget > .button:focus,
#logout:focus,
span#login_widget > .button.focus,
#logout.focus {
color: #333;
background-color: #e6e6e6;
border-color: #8c8c8c;
}
span#login_widget > .button:hover,
#logout:hover {
color: #333;
background-color: #e6e6e6;
border-color: #adadad;
}
span#login_widget > .button:active,
#logout:active,
span#login_widget > .button.active,
#logout.active,
.open > .dropdown-togglespan#login_widget > .button,
.open > .dropdown-toggle#logout {
color: #333;
background-color: #e6e6e6;
border-color: #adadad;
}
span#login_widget > .button:active:hover,
#logout:active:hover,
span#login_widget > .button.active:hover,
#logout.active:hover,
.open > .dropdown-togglespan#login_widget > .button:hover,
.open > .dropdown-toggle#logout:hover,
span#login_widget > .button:active:focus,
#logout:active:focus,
span#login_widget > .button.active:focus,
#logout.active:focus,
.open > .dropdown-togglespan#login_widget > .button:focus,
.open > .dropdown-toggle#logout:focus,
span#login_widget > .button:active.focus,
#logout:active.focus,
span#login_widget > .button.active.focus,
#logout.active.focus,
.open > .dropdown-togglespan#login_widget > .button.focus,
.open > .dropdown-toggle#logout.focus {
color: #333;
background-color: #d4d4d4;
border-color: #8c8c8c;
}
span#login_widget > .button:active,
#logout:active,
span#login_widget > .button.active,
#logout.active,
.open > .dropdown-togglespan#login_widget > .button,
.open > .dropdown-toggle#logout {
background-image: none;
}
span#login_widget > .button.disabled:hover,
#logout.disabled:hover,
span#login_widget > .button[disabled]:hover,
#logout[disabled]:hover,
fieldset[disabled] span#login_widget > .button:hover,
fieldset[disabled] #logout:hover,
span#login_widget > .button.disabled:focus,
#logout.disabled:focus,
span#login_widget > .button[disabled]:focus,
#logout[disabled]:focus,
fieldset[disabled] span#login_widget > .button:focus,
fieldset[disabled] #logout:focus,
span#login_widget > .button.disabled.focus,
#logout.disabled.focus,
span#login_widget > .button[disabled].focus,
#logout[disabled].focus,
fieldset[disabled] span#login_widget > .button.focus,
fieldset[disabled] #logout.focus {
background-color: #fff;
border-color: #ccc;
}
span#login_widget > .button .badge,
#logout .badge {
color: #fff;
background-color: #333;
}
.nav-header {
text-transform: none;
}
#header > span {
margin-top: 10px;
}
.modal_stretch .modal-dialog {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
min-height: 80vh;
}
.modal_stretch .modal-dialog .modal-body {
max-height: calc(100vh - 200px);
overflow: auto;
flex: 1;
}
@media (min-width: 768px) {
.modal .modal-dialog {
width: 700px;
}
}
@media (min-width: 768px) {
select.form-control {
margin-left: 12px;
margin-right: 12px;
}
}
/*!
*
* IPython auth
*
*/
.center-nav {
display: inline-block;
margin-bottom: -4px;
}
/*!
*
* IPython tree view
*
*/
/* We need an invisible input field on top of the sentense*/
/* "Drag file onto the list ..." */
.alternate_upload {
background-color: none;
display: inline;
}
.alternate_upload.form {
padding: 0;
margin: 0;
}
.alternate_upload input.fileinput {
text-align: center;
vertical-align: middle;
display: inline;
opacity: 0;
z-index: 2;
width: 12ex;
margin-right: -12ex;
}
.alternate_upload .btn-upload {
height: 22px;
}
/**
* Primary styles
*
* Author: Jupyter Development Team
*/
[dir="rtl"] #tabs li {
float: right;
}
ul#tabs {
margin-bottom: 4px;
}
[dir="rtl"] ul#tabs {
margin-right: 0px;
}
ul#tabs a {
padding-top: 6px;
padding-bottom: 4px;
}
ul.breadcrumb a:focus,
ul.breadcrumb a:hover {
text-decoration: none;
}
ul.breadcrumb i.icon-home {
font-size: 16px;
margin-right: 4px;
}
ul.breadcrumb span {
color: #5e5e5e;
}
.list_toolbar {
padding: 4px 0 4px 0;
vertical-align: middle;
}
.list_toolbar .tree-buttons {
padding-top: 1px;
}
[dir="rtl"] .list_toolbar .tree-buttons {
float: left !important;
}
[dir="rtl"] .list_toolbar .pull-right {
padding-top: 1px;
float: left !important;
}
[dir="rtl"] .list_toolbar .pull-left {
float: right !important;
}
.dynamic-buttons {
padding-top: 3px;
display: inline-block;
}
.list_toolbar [class*="span"] {
min-height: 24px;
}
.list_header {
font-weight: bold;
background-color: #EEE;
}
.list_placeholder {
font-weight: bold;
padding-top: 4px;
padding-bottom: 4px;
padding-left: 7px;
padding-right: 7px;
}
.list_container {
margin-top: 4px;
margin-bottom: 20px;
border: 1px solid #ddd;
border-radius: 2px;
}
.list_container > div {
border-bottom: 1px solid #ddd;
}
.list_container > div:hover .list-item {
background-color: red;
}
.list_container > div:last-child {
border: none;
}
.list_item:hover .list_item {
background-color: #ddd;
}
.list_item a {
text-decoration: none;
}
.list_item:hover {
background-color: #fafafa;
}
.list_header > div,
.list_item > div {
padding-top: 4px;
padding-bottom: 4px;
padding-left: 7px;
padding-right: 7px;
line-height: 22px;
}
.list_header > div input,
.list_item > div input {
margin-right: 7px;
margin-left: 14px;
vertical-align: baseline;
line-height: 22px;
position: relative;
top: -1px;
}
.list_header > div .item_link,
.list_item > div .item_link {
margin-left: -1px;
vertical-align: baseline;
line-height: 22px;
}
.new-file input[type=checkbox] {
visibility: hidden;
}
.item_name {
line-height: 22px;
height: 24px;
}
.item_icon {
font-size: 14px;
color: #5e5e5e;
margin-right: 7px;
margin-left: 7px;
line-height: 22px;
vertical-align: baseline;
}
.item_buttons {
line-height: 1em;
margin-left: -5px;
}
.item_buttons .btn,
.item_buttons .btn-group,
.item_buttons .input-group {
float: left;
}
.item_buttons > .btn,
.item_buttons > .btn-group,
.item_buttons > .input-group {
margin-left: 5px;
}
.item_buttons .btn {
min-width: 13ex;
}
.item_buttons .running-indicator {
padding-top: 4px;
color: #5cb85c;
}
.item_buttons .kernel-name {
padding-top: 4px;
color: #5bc0de;
margin-right: 7px;
float: left;
}
.toolbar_info {
height: 24px;
line-height: 24px;
}
.list_item input:not([type=checkbox]) {
padding-top: 3px;
padding-bottom: 3px;
height: 22px;
line-height: 14px;
margin: 0px;
}
.highlight_text {
color: blue;
}
#project_name {
display: inline-block;
padding-left: 7px;
margin-left: -2px;
}
#project_name > .breadcrumb {
padding: 0px;
margin-bottom: 0px;
background-color: transparent;
font-weight: bold;
}
#tree-selector {
padding-right: 0px;
}
[dir="rtl"] #tree-selector a {
float: right;
}
#button-select-all {
min-width: 50px;
}
#select-all {
margin-left: 7px;
margin-right: 2px;
}
.menu_icon {
margin-right: 2px;
}
.tab-content .row {
margin-left: 0px;
margin-right: 0px;
}
.folder_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f114";
}
.folder_icon:before.pull-left {
margin-right: .3em;
}
.folder_icon:before.pull-right {
margin-left: .3em;
}
.notebook_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f02d";
position: relative;
top: -1px;
}
.notebook_icon:before.pull-left {
margin-right: .3em;
}
.notebook_icon:before.pull-right {
margin-left: .3em;
}
.running_notebook_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f02d";
position: relative;
top: -1px;
color: #5cb85c;
}
.running_notebook_icon:before.pull-left {
margin-right: .3em;
}
.running_notebook_icon:before.pull-right {
margin-left: .3em;
}
.file_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f016";
position: relative;
top: -2px;
}
.file_icon:before.pull-left {
margin-right: .3em;
}
.file_icon:before.pull-right {
margin-left: .3em;
}
#notebook_toolbar .pull-right {
padding-top: 0px;
margin-right: -1px;
}
ul#new-menu {
left: auto;
right: 0;
}
[dir="rtl"] #new-menu {
text-align: right;
}
.kernel-menu-icon {
padding-right: 12px;
width: 24px;
content: "\f096";
}
.kernel-menu-icon:before {
content: "\f096";
}
.kernel-menu-icon-current:before {
content: "\f00c";
}
#tab_content {
padding-top: 20px;
}
#running .panel-group .panel {
margin-top: 3px;
margin-bottom: 1em;
}
#running .panel-group .panel .panel-heading {
background-color: #EEE;
padding-top: 4px;
padding-bottom: 4px;
padding-left: 7px;
padding-right: 7px;
line-height: 22px;
}
#running .panel-group .panel .panel-heading a:focus,
#running .panel-group .panel .panel-heading a:hover {
text-decoration: none;
}
#running .panel-group .panel .panel-body {
padding: 0px;
}
#running .panel-group .panel .panel-body .list_container {
margin-top: 0px;
margin-bottom: 0px;
border: 0px;
border-radius: 0px;
}
#running .panel-group .panel .panel-body .list_container .list_item {
border-bottom: 1px solid #ddd;
}
#running .panel-group .panel .panel-body .list_container .list_item:last-child {
border-bottom: 0px;
}
[dir="rtl"] #running .col-sm-8 {
float: right !important;
}
.delete-button {
display: none;
}
.duplicate-button {
display: none;
}
.rename-button {
display: none;
}
.shutdown-button {
display: none;
}
.dynamic-instructions {
display: inline-block;
padding-top: 4px;
}
/*!
*
* IPython text editor webapp
*
*/
.selected-keymap i.fa {
padding: 0px 5px;
}
.selected-keymap i.fa:before {
content: "\f00c";
}
#mode-menu {
overflow: auto;
max-height: 20em;
}
.edit_app #header {
-webkit-box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
}
.edit_app #menubar .navbar {
/* Use a negative 1 bottom margin, so the border overlaps the border of the
header */
margin-bottom: -1px;
}
.dirty-indicator {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
width: 20px;
}
.dirty-indicator.pull-left {
margin-right: .3em;
}
.dirty-indicator.pull-right {
margin-left: .3em;
}
.dirty-indicator-dirty {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
width: 20px;
}
.dirty-indicator-dirty.pull-left {
margin-right: .3em;
}
.dirty-indicator-dirty.pull-right {
margin-left: .3em;
}
.dirty-indicator-clean {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
width: 20px;
}
.dirty-indicator-clean.pull-left {
margin-right: .3em;
}
.dirty-indicator-clean.pull-right {
margin-left: .3em;
}
.dirty-indicator-clean:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f00c";
}
.dirty-indicator-clean:before.pull-left {
margin-right: .3em;
}
.dirty-indicator-clean:before.pull-right {
margin-left: .3em;
}
#filename {
font-size: 16pt;
display: table;
padding: 0px 5px;
}
#current-mode {
padding-left: 5px;
padding-right: 5px;
}
#texteditor-backdrop {
padding-top: 20px;
padding-bottom: 20px;
}
@media not print {
#texteditor-backdrop {
background-color: #EEE;
}
}
@media print {
#texteditor-backdrop #texteditor-container .CodeMirror-gutter,
#texteditor-backdrop #texteditor-container .CodeMirror-gutters {
background-color: #fff;
}
}
@media not print {
#texteditor-backdrop #texteditor-container .CodeMirror-gutter,
#texteditor-backdrop #texteditor-container .CodeMirror-gutters {
background-color: #fff;
}
}
@media not print {
#texteditor-backdrop #texteditor-container {
padding: 0px;
background-color: #fff;
-webkit-box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
}
}
/*!
*
* IPython notebook
*
*/
/* CSS font colors for translated ANSI colors. */
.ansibold {
font-weight: bold;
}
/* use dark versions for foreground, to improve visibility */
.ansiblack {
color: black;
}
.ansired {
color: darkred;
}
.ansigreen {
color: darkgreen;
}
.ansiyellow {
color: #c4a000;
}
.ansiblue {
color: darkblue;
}
.ansipurple {
color: darkviolet;
}
.ansicyan {
color: steelblue;
}
.ansigray {
color: gray;
}
/* and light for background, for the same reason */
.ansibgblack {
background-color: black;
}
.ansibgred {
background-color: red;
}
.ansibggreen {
background-color: green;
}
.ansibgyellow {
background-color: yellow;
}
.ansibgblue {
background-color: blue;
}
.ansibgpurple {
background-color: magenta;
}
.ansibgcyan {
background-color: cyan;
}
.ansibggray {
background-color: gray;
}
div.cell {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
border-radius: 2px;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
border-width: 1px;
border-style: solid;
border-color: transparent;
width: 100%;
padding: 5px;
/* This acts as a spacer between cells, that is outside the border */
margin: 0px;
outline: none;
border-left-width: 1px;
padding-left: 5px;
background: linear-gradient(to right, transparent -40px, transparent 1px, transparent 1px, transparent 100%);
}
div.cell.jupyter-soft-selected {
border-left-color: #90CAF9;
border-left-color: #E3F2FD;
border-left-width: 1px;
padding-left: 5px;
border-right-color: #E3F2FD;
border-right-width: 1px;
background: #E3F2FD;
}
@media print {
div.cell.jupyter-soft-selected {
border-color: transparent;
}
}
div.cell.selected {
border-color: #ababab;
border-left-width: 0px;
padding-left: 6px;
background: linear-gradient(to right, #42A5F5 -40px, #42A5F5 5px, transparent 5px, transparent 100%);
}
@media print {
div.cell.selected {
border-color: transparent;
}
}
div.cell.selected.jupyter-soft-selected {
border-left-width: 0;
padding-left: 6px;
background: linear-gradient(to right, #42A5F5 -40px, #42A5F5 7px, #E3F2FD 7px, #E3F2FD 100%);
}
.edit_mode div.cell.selected {
border-color: #66BB6A;
border-left-width: 0px;
padding-left: 6px;
background: linear-gradient(to right, #66BB6A -40px, #66BB6A 5px, transparent 5px, transparent 100%);
}
@media print {
.edit_mode div.cell.selected {
border-color: transparent;
}
}
.prompt {
/* This needs to be wide enough for 3 digit prompt numbers: In[100]: */
min-width: 14ex;
/* This padding is tuned to match the padding on the CodeMirror editor. */
padding: 0.4em;
margin: 0px;
font-family: monospace;
text-align: right;
/* This has to match that of the the CodeMirror class line-height below */
line-height: 1.21429em;
/* Don't highlight prompt number selection */
-webkit-touch-callout: none;
-webkit-user-select: none;
-khtml-user-select: none;
-moz-user-select: none;
-ms-user-select: none;
user-select: none;
/* Use default cursor */
cursor: default;
}
@media (max-width: 540px) {
.prompt {
text-align: left;
}
}
div.inner_cell {
min-width: 0;
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
/* Old browsers */
-webkit-box-flex: 1;
-moz-box-flex: 1;
box-flex: 1;
/* Modern browsers */
flex: 1;
}
/* input_area and input_prompt must match in top border and margin for alignment */
div.input_area {
border: 1px solid #cfcfcf;
border-radius: 2px;
background: #f7f7f7;
line-height: 1.21429em;
}
/* This is needed so that empty prompt areas can collapse to zero height when there
is no content in the output_subarea and the prompt. The main purpose of this is
to make sure that empty JavaScript output_subareas have no height. */
div.prompt:empty {
padding-top: 0;
padding-bottom: 0;
}
div.unrecognized_cell {
padding: 5px 5px 5px 0px;
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: horizontal;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: horizontal;
-moz-box-align: stretch;
display: box;
box-orient: horizontal;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: row;
align-items: stretch;
}
div.unrecognized_cell .inner_cell {
border-radius: 2px;
padding: 5px;
font-weight: bold;
color: red;
border: 1px solid #cfcfcf;
background: #eaeaea;
}
div.unrecognized_cell .inner_cell a {
color: inherit;
text-decoration: none;
}
div.unrecognized_cell .inner_cell a:hover {
color: inherit;
text-decoration: none;
}
@media (max-width: 540px) {
div.unrecognized_cell > div.prompt {
display: none;
}
}
div.code_cell {
/* avoid page breaking on code cells when printing */
}
@media print {
div.code_cell {
page-break-inside: avoid;
}
}
/* any special styling for code cells that are currently running goes here */
div.input {
page-break-inside: avoid;
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: horizontal;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: horizontal;
-moz-box-align: stretch;
display: box;
box-orient: horizontal;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: row;
align-items: stretch;
}
@media (max-width: 540px) {
div.input {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
}
}
/* input_area and input_prompt must match in top border and margin for alignment */
div.input_prompt {
color: #303F9F;
border-top: 1px solid transparent;
}
div.input_area > div.highlight {
margin: 0.4em;
border: none;
padding: 0px;
background-color: transparent;
}
div.input_area > div.highlight > pre {
margin: 0px;
border: none;
padding: 0px;
background-color: transparent;
}
/* The following gets added to the <head> if it is detected that the user has a
* monospace font with inconsistent normal/bold/italic height. See
* notebookmain.js. Such fonts will have keywords vertically offset with
* respect to the rest of the text. The user should select a better font.
* See: https://github.com/ipython/ipython/issues/1503
*
* .CodeMirror span {
* vertical-align: bottom;
* }
*/
.CodeMirror {
line-height: 1.21429em;
/* Changed from 1em to our global default */
font-size: 14px;
height: auto;
/* Changed to auto to autogrow */
background: none;
/* Changed from white to allow our bg to show through */
}
.CodeMirror-scroll {
/* The CodeMirror docs are a bit fuzzy on if overflow-y should be hidden or visible.*/
/* We have found that if it is visible, vertical scrollbars appear with font size changes.*/
overflow-y: hidden;
overflow-x: auto;
}
.CodeMirror-lines {
/* In CM2, this used to be 0.4em, but in CM3 it went to 4px. We need the em value because */
/* we have set a different line-height and want this to scale with that. */
padding: 0.4em;
}
.CodeMirror-linenumber {
padding: 0 8px 0 4px;
}
.CodeMirror-gutters {
border-bottom-left-radius: 2px;
border-top-left-radius: 2px;
}
.CodeMirror pre {
/* In CM3 this went to 4px from 0 in CM2. We need the 0 value because of how we size */
/* .CodeMirror-lines */
padding: 0;
border: 0;
border-radius: 0;
}
/*
Original style from softwaremaniacs.org (c) Ivan Sagalaev <Maniac@SoftwareManiacs.Org>
Adapted from GitHub theme
*/
.highlight-base {
color: #000;
}
.highlight-variable {
color: #000;
}
.highlight-variable-2 {
color: #1a1a1a;
}
.highlight-variable-3 {
color: #333333;
}
.highlight-string {
color: #BA2121;
}
.highlight-comment {
color: #408080;
font-style: italic;
}
.highlight-number {
color: #080;
}
.highlight-atom {
color: #88F;
}
.highlight-keyword {
color: #008000;
font-weight: bold;
}
.highlight-builtin {
color: #008000;
}
.highlight-error {
color: #f00;
}
.highlight-operator {
color: #AA22FF;
font-weight: bold;
}
.highlight-meta {
color: #AA22FF;
}
/* previously not defined, copying from default codemirror */
.highlight-def {
color: #00f;
}
.highlight-string-2 {
color: #f50;
}
.highlight-qualifier {
color: #555;
}
.highlight-bracket {
color: #997;
}
.highlight-tag {
color: #170;
}
.highlight-attribute {
color: #00c;
}
.highlight-header {
color: blue;
}
.highlight-quote {
color: #090;
}
.highlight-link {
color: #00c;
}
/* apply the same style to codemirror */
.cm-s-ipython span.cm-keyword {
color: #008000;
font-weight: bold;
}
.cm-s-ipython span.cm-atom {
color: #88F;
}
.cm-s-ipython span.cm-number {
color: #080;
}
.cm-s-ipython span.cm-def {
color: #00f;
}
.cm-s-ipython span.cm-variable {
color: #000;
}
.cm-s-ipython span.cm-operator {
color: #AA22FF;
font-weight: bold;
}
.cm-s-ipython span.cm-variable-2 {
color: #1a1a1a;
}
.cm-s-ipython span.cm-variable-3 {
color: #333333;
}
.cm-s-ipython span.cm-comment {
color: #408080;
font-style: italic;
}
.cm-s-ipython span.cm-string {
color: #BA2121;
}
.cm-s-ipython span.cm-string-2 {
color: #f50;
}
.cm-s-ipython span.cm-meta {
color: #AA22FF;
}
.cm-s-ipython span.cm-qualifier {
color: #555;
}
.cm-s-ipython span.cm-builtin {
color: #008000;
}
.cm-s-ipython span.cm-bracket {
color: #997;
}
.cm-s-ipython span.cm-tag {
color: #170;
}
.cm-s-ipython span.cm-attribute {
color: #00c;
}
.cm-s-ipython span.cm-header {
color: blue;
}
.cm-s-ipython span.cm-quote {
color: #090;
}
.cm-s-ipython span.cm-link {
color: #00c;
}
.cm-s-ipython span.cm-error {
color: #f00;
}
.cm-s-ipython span.cm-tab {
background: url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAADAAAAAMCAYAAAAkuj5RAAAAAXNSR0IArs4c6QAAAGFJREFUSMft1LsRQFAQheHPowAKoACx3IgEKtaEHujDjORSgWTH/ZOdnZOcM/sgk/kFFWY0qV8foQwS4MKBCS3qR6ixBJvElOobYAtivseIE120FaowJPN75GMu8j/LfMwNjh4HUpwg4LUAAAAASUVORK5CYII=);
background-position: right;
background-repeat: no-repeat;
}
div.output_wrapper {
/* this position must be relative to enable descendents to be absolute within it */
position: relative;
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
z-index: 1;
}
/* class for the output area when it should be height-limited */
div.output_scroll {
/* ideally, this would be max-height, but FF barfs all over that */
height: 24em;
/* FF needs this *and the wrapper* to specify full width, or it will shrinkwrap */
width: 100%;
overflow: auto;
border-radius: 2px;
-webkit-box-shadow: inset 0 2px 8px rgba(0, 0, 0, 0.8);
box-shadow: inset 0 2px 8px rgba(0, 0, 0, 0.8);
display: block;
}
/* output div while it is collapsed */
div.output_collapsed {
margin: 0px;
padding: 0px;
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
}
div.out_prompt_overlay {
height: 100%;
padding: 0px 0.4em;
position: absolute;
border-radius: 2px;
}
div.out_prompt_overlay:hover {
/* use inner shadow to get border that is computed the same on WebKit/FF */
-webkit-box-shadow: inset 0 0 1px #000;
box-shadow: inset 0 0 1px #000;
background: rgba(240, 240, 240, 0.5);
}
div.output_prompt {
color: #D84315;
}
/* This class is the outer container of all output sections. */
div.output_area {
padding: 0px;
page-break-inside: avoid;
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: horizontal;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: horizontal;
-moz-box-align: stretch;
display: box;
box-orient: horizontal;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: row;
align-items: stretch;
}
div.output_area .MathJax_Display {
text-align: left !important;
}
div.output_area .rendered_html table {
margin-left: 0;
margin-right: 0;
}
div.output_area .rendered_html img {
margin-left: 0;
margin-right: 0;
}
div.output_area img,
div.output_area svg {
max-width: 100%;
height: auto;
}
div.output_area img.unconfined,
div.output_area svg.unconfined {
max-width: none;
}
/* This is needed to protect the pre formating from global settings such
as that of bootstrap */
.output {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
}
@media (max-width: 540px) {
div.output_area {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: vertical;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: vertical;
-moz-box-align: stretch;
display: box;
box-orient: vertical;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: column;
align-items: stretch;
}
}
div.output_area pre {
margin: 0;
padding: 0;
border: 0;
vertical-align: baseline;
color: black;
background-color: transparent;
border-radius: 0;
}
/* This class is for the output subarea inside the output_area and after
the prompt div. */
div.output_subarea {
overflow-x: auto;
padding: 0.4em;
/* Old browsers */
-webkit-box-flex: 1;
-moz-box-flex: 1;
box-flex: 1;
/* Modern browsers */
flex: 1;
max-width: calc(100% - 14ex);
}
div.output_scroll div.output_subarea {
overflow-x: visible;
}
/* The rest of the output_* classes are for special styling of the different
output types */
/* all text output has this class: */
div.output_text {
text-align: left;
color: #000;
/* This has to match that of the the CodeMirror class line-height below */
line-height: 1.21429em;
}
/* stdout/stderr are 'text' as well as 'stream', but execute_result/error are *not* streams */
div.output_stderr {
background: #fdd;
/* very light red background for stderr */
}
div.output_latex {
text-align: left;
}
/* Empty output_javascript divs should have no height */
div.output_javascript:empty {
padding: 0;
}
.js-error {
color: darkred;
}
/* raw_input styles */
div.raw_input_container {
line-height: 1.21429em;
padding-top: 5px;
}
pre.raw_input_prompt {
/* nothing needed here. */
}
input.raw_input {
font-family: monospace;
font-size: inherit;
color: inherit;
width: auto;
/* make sure input baseline aligns with prompt */
vertical-align: baseline;
/* padding + margin = 0.5em between prompt and cursor */
padding: 0em 0.25em;
margin: 0em 0.25em;
}
input.raw_input:focus {
box-shadow: none;
}
p.p-space {
margin-bottom: 10px;
}
div.output_unrecognized {
padding: 5px;
font-weight: bold;
color: red;
}
div.output_unrecognized a {
color: inherit;
text-decoration: none;
}
div.output_unrecognized a:hover {
color: inherit;
text-decoration: none;
}
.rendered_html {
color: #000;
/* any extras will just be numbers: */
}
.rendered_html em {
font-style: italic;
}
.rendered_html strong {
font-weight: bold;
}
.rendered_html u {
text-decoration: underline;
}
.rendered_html :link {
text-decoration: underline;
}
.rendered_html :visited {
text-decoration: underline;
}
.rendered_html h1 {
font-size: 185.7%;
margin: 1.08em 0 0 0;
font-weight: bold;
line-height: 1.0;
}
.rendered_html h2 {
font-size: 157.1%;
margin: 1.27em 0 0 0;
font-weight: bold;
line-height: 1.0;
}
.rendered_html h3 {
font-size: 128.6%;
margin: 1.55em 0 0 0;
font-weight: bold;
line-height: 1.0;
}
.rendered_html h4 {
font-size: 100%;
margin: 2em 0 0 0;
font-weight: bold;
line-height: 1.0;
}
.rendered_html h5 {
font-size: 100%;
margin: 2em 0 0 0;
font-weight: bold;
line-height: 1.0;
font-style: italic;
}
.rendered_html h6 {
font-size: 100%;
margin: 2em 0 0 0;
font-weight: bold;
line-height: 1.0;
font-style: italic;
}
.rendered_html h1:first-child {
margin-top: 0.538em;
}
.rendered_html h2:first-child {
margin-top: 0.636em;
}
.rendered_html h3:first-child {
margin-top: 0.777em;
}
.rendered_html h4:first-child {
margin-top: 1em;
}
.rendered_html h5:first-child {
margin-top: 1em;
}
.rendered_html h6:first-child {
margin-top: 1em;
}
.rendered_html ul {
list-style: disc;
margin: 0em 2em;
padding-left: 0px;
}
.rendered_html ul ul {
list-style: square;
margin: 0em 2em;
}
.rendered_html ul ul ul {
list-style: circle;
margin: 0em 2em;
}
.rendered_html ol {
list-style: decimal;
margin: 0em 2em;
padding-left: 0px;
}
.rendered_html ol ol {
list-style: upper-alpha;
margin: 0em 2em;
}
.rendered_html ol ol ol {
list-style: lower-alpha;
margin: 0em 2em;
}
.rendered_html ol ol ol ol {
list-style: lower-roman;
margin: 0em 2em;
}
.rendered_html ol ol ol ol ol {
list-style: decimal;
margin: 0em 2em;
}
.rendered_html * + ul {
margin-top: 1em;
}
.rendered_html * + ol {
margin-top: 1em;
}
.rendered_html hr {
color: black;
background-color: black;
}
.rendered_html pre {
margin: 1em 2em;
}
.rendered_html pre,
.rendered_html code {
border: 0;
background-color: #fff;
color: #000;
font-size: 100%;
padding: 0px;
}
.rendered_html blockquote {
margin: 1em 2em;
}
.rendered_html table {
margin-left: auto;
margin-right: auto;
border: 1px solid black;
border-collapse: collapse;
}
.rendered_html tr,
.rendered_html th,
.rendered_html td {
border: 1px solid black;
border-collapse: collapse;
margin: 1em 2em;
}
.rendered_html td,
.rendered_html th {
text-align: left;
vertical-align: middle;
padding: 4px;
}
.rendered_html th {
font-weight: bold;
}
.rendered_html * + table {
margin-top: 1em;
}
.rendered_html p {
text-align: left;
}
.rendered_html * + p {
margin-top: 1em;
}
.rendered_html img {
display: block;
margin-left: auto;
margin-right: auto;
}
.rendered_html * + img {
margin-top: 1em;
}
.rendered_html img,
.rendered_html svg {
max-width: 100%;
height: auto;
}
.rendered_html img.unconfined,
.rendered_html svg.unconfined {
max-width: none;
}
div.text_cell {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: horizontal;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: horizontal;
-moz-box-align: stretch;
display: box;
box-orient: horizontal;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: row;
align-items: stretch;
}
@media (max-width: 540px) {
div.text_cell > div.prompt {
display: none;
}
}
div.text_cell_render {
/*font-family: "Helvetica Neue", Arial, Helvetica, Geneva, sans-serif;*/
outline: none;
resize: none;
width: inherit;
border-style: none;
padding: 0.5em 0.5em 0.5em 0.4em;
color: #000;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
}
a.anchor-link:link {
text-decoration: none;
padding: 0px 20px;
visibility: hidden;
}
h1:hover .anchor-link,
h2:hover .anchor-link,
h3:hover .anchor-link,
h4:hover .anchor-link,
h5:hover .anchor-link,
h6:hover .anchor-link {
visibility: visible;
}
.text_cell.rendered .input_area {
display: none;
}
.text_cell.rendered .rendered_html {
overflow-x: auto;
overflow-y: hidden;
}
.text_cell.unrendered .text_cell_render {
display: none;
}
.cm-header-1,
.cm-header-2,
.cm-header-3,
.cm-header-4,
.cm-header-5,
.cm-header-6 {
font-weight: bold;
font-family: "Helvetica Neue", Helvetica, Arial, sans-serif;
}
.cm-header-1 {
font-size: 185.7%;
}
.cm-header-2 {
font-size: 157.1%;
}
.cm-header-3 {
font-size: 128.6%;
}
.cm-header-4 {
font-size: 110%;
}
.cm-header-5 {
font-size: 100%;
font-style: italic;
}
.cm-header-6 {
font-size: 100%;
font-style: italic;
}
/*!
*
* IPython notebook webapp
*
*/
@media (max-width: 767px) {
.notebook_app {
padding-left: 0px;
padding-right: 0px;
}
}
#ipython-main-app {
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
height: 100%;
}
div#notebook_panel {
margin: 0px;
padding: 0px;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
height: 100%;
}
div#notebook {
font-size: 14px;
line-height: 20px;
overflow-y: hidden;
overflow-x: auto;
width: 100%;
/* This spaces the page away from the edge of the notebook area */
padding-top: 20px;
margin: 0px;
outline: none;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
min-height: 100%;
}
@media not print {
#notebook-container {
padding: 15px;
background-color: #fff;
min-height: 0;
-webkit-box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
}
}
@media print {
#notebook-container {
width: 100%;
}
}
div.ui-widget-content {
border: 1px solid #ababab;
outline: none;
}
pre.dialog {
background-color: #f7f7f7;
border: 1px solid #ddd;
border-radius: 2px;
padding: 0.4em;
padding-left: 2em;
}
p.dialog {
padding: 0.2em;
}
/* Word-wrap output correctly. This is the CSS3 spelling, though Firefox seems
to not honor it correctly. Webkit browsers (Chrome, rekonq, Safari) do.
*/
pre,
code,
kbd,
samp {
white-space: pre-wrap;
}
#fonttest {
font-family: monospace;
}
p {
margin-bottom: 0;
}
.end_space {
min-height: 100px;
transition: height .2s ease;
}
.notebook_app > #header {
-webkit-box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
}
@media not print {
.notebook_app {
background-color: #EEE;
}
}
kbd {
border-style: solid;
border-width: 1px;
box-shadow: none;
margin: 2px;
padding-left: 2px;
padding-right: 2px;
padding-top: 1px;
padding-bottom: 1px;
}
/* CSS for the cell toolbar */
.celltoolbar {
border: thin solid #CFCFCF;
border-bottom: none;
background: #EEE;
border-radius: 2px 2px 0px 0px;
width: 100%;
height: 29px;
padding-right: 4px;
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: horizontal;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: horizontal;
-moz-box-align: stretch;
display: box;
box-orient: horizontal;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: row;
align-items: stretch;
/* Old browsers */
-webkit-box-pack: end;
-moz-box-pack: end;
box-pack: end;
/* Modern browsers */
justify-content: flex-end;
display: -webkit-flex;
}
@media print {
.celltoolbar {
display: none;
}
}
.ctb_hideshow {
display: none;
vertical-align: bottom;
}
/* ctb_show is added to the ctb_hideshow div to show the cell toolbar.
Cell toolbars are only shown when the ctb_global_show class is also set.
*/
.ctb_global_show .ctb_show.ctb_hideshow {
display: block;
}
.ctb_global_show .ctb_show + .input_area,
.ctb_global_show .ctb_show + div.text_cell_input,
.ctb_global_show .ctb_show ~ div.text_cell_render {
border-top-right-radius: 0px;
border-top-left-radius: 0px;
}
.ctb_global_show .ctb_show ~ div.text_cell_render {
border: 1px solid #cfcfcf;
}
.celltoolbar {
font-size: 87%;
padding-top: 3px;
}
.celltoolbar select {
display: block;
width: 100%;
height: 32px;
padding: 6px 12px;
font-size: 13px;
line-height: 1.42857143;
color: #555555;
background-color: #fff;
background-image: none;
border: 1px solid #ccc;
border-radius: 2px;
-webkit-box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
box-shadow: inset 0 1px 1px rgba(0, 0, 0, 0.075);
-webkit-transition: border-color ease-in-out .15s, box-shadow ease-in-out .15s;
-o-transition: border-color ease-in-out .15s, box-shadow ease-in-out .15s;
transition: border-color ease-in-out .15s, box-shadow ease-in-out .15s;
height: 30px;
padding: 5px 10px;
font-size: 12px;
line-height: 1.5;
border-radius: 1px;
width: inherit;
font-size: inherit;
height: 22px;
padding: 0px;
display: inline-block;
}
.celltoolbar select:focus {
border-color: #66afe9;
outline: 0;
-webkit-box-shadow: inset 0 1px 1px rgba(0,0,0,.075), 0 0 8px rgba(102, 175, 233, 0.6);
box-shadow: inset 0 1px 1px rgba(0,0,0,.075), 0 0 8px rgba(102, 175, 233, 0.6);
}
.celltoolbar select::-moz-placeholder {
color: #999;
opacity: 1;
}
.celltoolbar select:-ms-input-placeholder {
color: #999;
}
.celltoolbar select::-webkit-input-placeholder {
color: #999;
}
.celltoolbar select::-ms-expand {
border: 0;
background-color: transparent;
}
.celltoolbar select[disabled],
.celltoolbar select[readonly],
fieldset[disabled] .celltoolbar select {
background-color: #eeeeee;
opacity: 1;
}
.celltoolbar select[disabled],
fieldset[disabled] .celltoolbar select {
cursor: not-allowed;
}
textarea.celltoolbar select {
height: auto;
}
select.celltoolbar select {
height: 30px;
line-height: 30px;
}
textarea.celltoolbar select,
select[multiple].celltoolbar select {
height: auto;
}
.celltoolbar label {
margin-left: 5px;
margin-right: 5px;
}
.completions {
position: absolute;
z-index: 110;
overflow: hidden;
border: 1px solid #ababab;
border-radius: 2px;
-webkit-box-shadow: 0px 6px 10px -1px #adadad;
box-shadow: 0px 6px 10px -1px #adadad;
line-height: 1;
}
.completions select {
background: white;
outline: none;
border: none;
padding: 0px;
margin: 0px;
overflow: auto;
font-family: monospace;
font-size: 110%;
color: #000;
width: auto;
}
.completions select option.context {
color: #286090;
}
#kernel_logo_widget {
float: right !important;
float: right;
}
#kernel_logo_widget .current_kernel_logo {
display: none;
margin-top: -1px;
margin-bottom: -1px;
width: 32px;
height: 32px;
}
#menubar {
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
margin-top: 1px;
}
#menubar .navbar {
border-top: 1px;
border-radius: 0px 0px 2px 2px;
margin-bottom: 0px;
}
#menubar .navbar-toggle {
float: left;
padding-top: 7px;
padding-bottom: 7px;
border: none;
}
#menubar .navbar-collapse {
clear: left;
}
.nav-wrapper {
border-bottom: 1px solid #e7e7e7;
}
i.menu-icon {
padding-top: 4px;
}
ul#help_menu li a {
overflow: hidden;
padding-right: 2.2em;
}
ul#help_menu li a i {
margin-right: -1.2em;
}
.dropdown-submenu {
position: relative;
}
.dropdown-submenu > .dropdown-menu {
top: 0;
left: 100%;
margin-top: -6px;
margin-left: -1px;
}
.dropdown-submenu:hover > .dropdown-menu {
display: block;
}
.dropdown-submenu > a:after {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
display: block;
content: "\f0da";
float: right;
color: #333333;
margin-top: 2px;
margin-right: -10px;
}
.dropdown-submenu > a:after.pull-left {
margin-right: .3em;
}
.dropdown-submenu > a:after.pull-right {
margin-left: .3em;
}
.dropdown-submenu:hover > a:after {
color: #262626;
}
.dropdown-submenu.pull-left {
float: none;
}
.dropdown-submenu.pull-left > .dropdown-menu {
left: -100%;
margin-left: 10px;
}
#notification_area {
float: right !important;
float: right;
z-index: 10;
}
.indicator_area {
float: right !important;
float: right;
color: #777;
margin-left: 5px;
margin-right: 5px;
width: 11px;
z-index: 10;
text-align: center;
width: auto;
}
#kernel_indicator {
float: right !important;
float: right;
color: #777;
margin-left: 5px;
margin-right: 5px;
width: 11px;
z-index: 10;
text-align: center;
width: auto;
border-left: 1px solid;
}
#kernel_indicator .kernel_indicator_name {
padding-left: 5px;
padding-right: 5px;
}
#modal_indicator {
float: right !important;
float: right;
color: #777;
margin-left: 5px;
margin-right: 5px;
width: 11px;
z-index: 10;
text-align: center;
width: auto;
}
#readonly-indicator {
float: right !important;
float: right;
color: #777;
margin-left: 5px;
margin-right: 5px;
width: 11px;
z-index: 10;
text-align: center;
width: auto;
margin-top: 2px;
margin-bottom: 0px;
margin-left: 0px;
margin-right: 0px;
display: none;
}
.modal_indicator:before {
width: 1.28571429em;
text-align: center;
}
.edit_mode .modal_indicator:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f040";
}
.edit_mode .modal_indicator:before.pull-left {
margin-right: .3em;
}
.edit_mode .modal_indicator:before.pull-right {
margin-left: .3em;
}
.command_mode .modal_indicator:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: ' ';
}
.command_mode .modal_indicator:before.pull-left {
margin-right: .3em;
}
.command_mode .modal_indicator:before.pull-right {
margin-left: .3em;
}
.kernel_idle_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f10c";
}
.kernel_idle_icon:before.pull-left {
margin-right: .3em;
}
.kernel_idle_icon:before.pull-right {
margin-left: .3em;
}
.kernel_busy_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f111";
}
.kernel_busy_icon:before.pull-left {
margin-right: .3em;
}
.kernel_busy_icon:before.pull-right {
margin-left: .3em;
}
.kernel_dead_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f1e2";
}
.kernel_dead_icon:before.pull-left {
margin-right: .3em;
}
.kernel_dead_icon:before.pull-right {
margin-left: .3em;
}
.kernel_disconnected_icon:before {
display: inline-block;
font: normal normal normal 14px/1 FontAwesome;
font-size: inherit;
text-rendering: auto;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
content: "\f127";
}
.kernel_disconnected_icon:before.pull-left {
margin-right: .3em;
}
.kernel_disconnected_icon:before.pull-right {
margin-left: .3em;
}
.notification_widget {
color: #777;
z-index: 10;
background: rgba(240, 240, 240, 0.5);
margin-right: 4px;
color: #333;
background-color: #fff;
border-color: #ccc;
}
.notification_widget:focus,
.notification_widget.focus {
color: #333;
background-color: #e6e6e6;
border-color: #8c8c8c;
}
.notification_widget:hover {
color: #333;
background-color: #e6e6e6;
border-color: #adadad;
}
.notification_widget:active,
.notification_widget.active,
.open > .dropdown-toggle.notification_widget {
color: #333;
background-color: #e6e6e6;
border-color: #adadad;
}
.notification_widget:active:hover,
.notification_widget.active:hover,
.open > .dropdown-toggle.notification_widget:hover,
.notification_widget:active:focus,
.notification_widget.active:focus,
.open > .dropdown-toggle.notification_widget:focus,
.notification_widget:active.focus,
.notification_widget.active.focus,
.open > .dropdown-toggle.notification_widget.focus {
color: #333;
background-color: #d4d4d4;
border-color: #8c8c8c;
}
.notification_widget:active,
.notification_widget.active,
.open > .dropdown-toggle.notification_widget {
background-image: none;
}
.notification_widget.disabled:hover,
.notification_widget[disabled]:hover,
fieldset[disabled] .notification_widget:hover,
.notification_widget.disabled:focus,
.notification_widget[disabled]:focus,
fieldset[disabled] .notification_widget:focus,
.notification_widget.disabled.focus,
.notification_widget[disabled].focus,
fieldset[disabled] .notification_widget.focus {
background-color: #fff;
border-color: #ccc;
}
.notification_widget .badge {
color: #fff;
background-color: #333;
}
.notification_widget.warning {
color: #fff;
background-color: #f0ad4e;
border-color: #eea236;
}
.notification_widget.warning:focus,
.notification_widget.warning.focus {
color: #fff;
background-color: #ec971f;
border-color: #985f0d;
}
.notification_widget.warning:hover {
color: #fff;
background-color: #ec971f;
border-color: #d58512;
}
.notification_widget.warning:active,
.notification_widget.warning.active,
.open > .dropdown-toggle.notification_widget.warning {
color: #fff;
background-color: #ec971f;
border-color: #d58512;
}
.notification_widget.warning:active:hover,
.notification_widget.warning.active:hover,
.open > .dropdown-toggle.notification_widget.warning:hover,
.notification_widget.warning:active:focus,
.notification_widget.warning.active:focus,
.open > .dropdown-toggle.notification_widget.warning:focus,
.notification_widget.warning:active.focus,
.notification_widget.warning.active.focus,
.open > .dropdown-toggle.notification_widget.warning.focus {
color: #fff;
background-color: #d58512;
border-color: #985f0d;
}
.notification_widget.warning:active,
.notification_widget.warning.active,
.open > .dropdown-toggle.notification_widget.warning {
background-image: none;
}
.notification_widget.warning.disabled:hover,
.notification_widget.warning[disabled]:hover,
fieldset[disabled] .notification_widget.warning:hover,
.notification_widget.warning.disabled:focus,
.notification_widget.warning[disabled]:focus,
fieldset[disabled] .notification_widget.warning:focus,
.notification_widget.warning.disabled.focus,
.notification_widget.warning[disabled].focus,
fieldset[disabled] .notification_widget.warning.focus {
background-color: #f0ad4e;
border-color: #eea236;
}
.notification_widget.warning .badge {
color: #f0ad4e;
background-color: #fff;
}
.notification_widget.success {
color: #fff;
background-color: #5cb85c;
border-color: #4cae4c;
}
.notification_widget.success:focus,
.notification_widget.success.focus {
color: #fff;
background-color: #449d44;
border-color: #255625;
}
.notification_widget.success:hover {
color: #fff;
background-color: #449d44;
border-color: #398439;
}
.notification_widget.success:active,
.notification_widget.success.active,
.open > .dropdown-toggle.notification_widget.success {
color: #fff;
background-color: #449d44;
border-color: #398439;
}
.notification_widget.success:active:hover,
.notification_widget.success.active:hover,
.open > .dropdown-toggle.notification_widget.success:hover,
.notification_widget.success:active:focus,
.notification_widget.success.active:focus,
.open > .dropdown-toggle.notification_widget.success:focus,
.notification_widget.success:active.focus,
.notification_widget.success.active.focus,
.open > .dropdown-toggle.notification_widget.success.focus {
color: #fff;
background-color: #398439;
border-color: #255625;
}
.notification_widget.success:active,
.notification_widget.success.active,
.open > .dropdown-toggle.notification_widget.success {
background-image: none;
}
.notification_widget.success.disabled:hover,
.notification_widget.success[disabled]:hover,
fieldset[disabled] .notification_widget.success:hover,
.notification_widget.success.disabled:focus,
.notification_widget.success[disabled]:focus,
fieldset[disabled] .notification_widget.success:focus,
.notification_widget.success.disabled.focus,
.notification_widget.success[disabled].focus,
fieldset[disabled] .notification_widget.success.focus {
background-color: #5cb85c;
border-color: #4cae4c;
}
.notification_widget.success .badge {
color: #5cb85c;
background-color: #fff;
}
.notification_widget.info {
color: #fff;
background-color: #5bc0de;
border-color: #46b8da;
}
.notification_widget.info:focus,
.notification_widget.info.focus {
color: #fff;
background-color: #31b0d5;
border-color: #1b6d85;
}
.notification_widget.info:hover {
color: #fff;
background-color: #31b0d5;
border-color: #269abc;
}
.notification_widget.info:active,
.notification_widget.info.active,
.open > .dropdown-toggle.notification_widget.info {
color: #fff;
background-color: #31b0d5;
border-color: #269abc;
}
.notification_widget.info:active:hover,
.notification_widget.info.active:hover,
.open > .dropdown-toggle.notification_widget.info:hover,
.notification_widget.info:active:focus,
.notification_widget.info.active:focus,
.open > .dropdown-toggle.notification_widget.info:focus,
.notification_widget.info:active.focus,
.notification_widget.info.active.focus,
.open > .dropdown-toggle.notification_widget.info.focus {
color: #fff;
background-color: #269abc;
border-color: #1b6d85;
}
.notification_widget.info:active,
.notification_widget.info.active,
.open > .dropdown-toggle.notification_widget.info {
background-image: none;
}
.notification_widget.info.disabled:hover,
.notification_widget.info[disabled]:hover,
fieldset[disabled] .notification_widget.info:hover,
.notification_widget.info.disabled:focus,
.notification_widget.info[disabled]:focus,
fieldset[disabled] .notification_widget.info:focus,
.notification_widget.info.disabled.focus,
.notification_widget.info[disabled].focus,
fieldset[disabled] .notification_widget.info.focus {
background-color: #5bc0de;
border-color: #46b8da;
}
.notification_widget.info .badge {
color: #5bc0de;
background-color: #fff;
}
.notification_widget.danger {
color: #fff;
background-color: #d9534f;
border-color: #d43f3a;
}
.notification_widget.danger:focus,
.notification_widget.danger.focus {
color: #fff;
background-color: #c9302c;
border-color: #761c19;
}
.notification_widget.danger:hover {
color: #fff;
background-color: #c9302c;
border-color: #ac2925;
}
.notification_widget.danger:active,
.notification_widget.danger.active,
.open > .dropdown-toggle.notification_widget.danger {
color: #fff;
background-color: #c9302c;
border-color: #ac2925;
}
.notification_widget.danger:active:hover,
.notification_widget.danger.active:hover,
.open > .dropdown-toggle.notification_widget.danger:hover,
.notification_widget.danger:active:focus,
.notification_widget.danger.active:focus,
.open > .dropdown-toggle.notification_widget.danger:focus,
.notification_widget.danger:active.focus,
.notification_widget.danger.active.focus,
.open > .dropdown-toggle.notification_widget.danger.focus {
color: #fff;
background-color: #ac2925;
border-color: #761c19;
}
.notification_widget.danger:active,
.notification_widget.danger.active,
.open > .dropdown-toggle.notification_widget.danger {
background-image: none;
}
.notification_widget.danger.disabled:hover,
.notification_widget.danger[disabled]:hover,
fieldset[disabled] .notification_widget.danger:hover,
.notification_widget.danger.disabled:focus,
.notification_widget.danger[disabled]:focus,
fieldset[disabled] .notification_widget.danger:focus,
.notification_widget.danger.disabled.focus,
.notification_widget.danger[disabled].focus,
fieldset[disabled] .notification_widget.danger.focus {
background-color: #d9534f;
border-color: #d43f3a;
}
.notification_widget.danger .badge {
color: #d9534f;
background-color: #fff;
}
div#pager {
background-color: #fff;
font-size: 14px;
line-height: 20px;
overflow: hidden;
display: none;
position: fixed;
bottom: 0px;
width: 100%;
max-height: 50%;
padding-top: 8px;
-webkit-box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
/* Display over codemirror */
z-index: 100;
/* Hack which prevents jquery ui resizable from changing top. */
top: auto !important;
}
div#pager pre {
line-height: 1.21429em;
color: #000;
background-color: #f7f7f7;
padding: 0.4em;
}
div#pager #pager-button-area {
position: absolute;
top: 8px;
right: 20px;
}
div#pager #pager-contents {
position: relative;
overflow: auto;
width: 100%;
height: 100%;
}
div#pager #pager-contents #pager-container {
position: relative;
padding: 15px 0px;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
}
div#pager .ui-resizable-handle {
top: 0px;
height: 8px;
background: #f7f7f7;
border-top: 1px solid #cfcfcf;
border-bottom: 1px solid #cfcfcf;
/* This injects handle bars (a short, wide = symbol) for
the resize handle. */
}
div#pager .ui-resizable-handle::after {
content: '';
top: 2px;
left: 50%;
height: 3px;
width: 30px;
margin-left: -15px;
position: absolute;
border-top: 1px solid #cfcfcf;
}
.quickhelp {
/* Old browsers */
display: -webkit-box;
-webkit-box-orient: horizontal;
-webkit-box-align: stretch;
display: -moz-box;
-moz-box-orient: horizontal;
-moz-box-align: stretch;
display: box;
box-orient: horizontal;
box-align: stretch;
/* Modern browsers */
display: flex;
flex-direction: row;
align-items: stretch;
line-height: 1.8em;
}
.shortcut_key {
display: inline-block;
width: 21ex;
text-align: right;
font-family: monospace;
}
.shortcut_descr {
display: inline-block;
/* Old browsers */
-webkit-box-flex: 1;
-moz-box-flex: 1;
box-flex: 1;
/* Modern browsers */
flex: 1;
}
span.save_widget {
margin-top: 6px;
}
span.save_widget span.filename {
height: 1em;
line-height: 1em;
padding: 3px;
margin-left: 16px;
border: none;
font-size: 146.5%;
border-radius: 2px;
}
span.save_widget span.filename:hover {
background-color: #e6e6e6;
}
span.checkpoint_status,
span.autosave_status {
font-size: small;
}
@media (max-width: 767px) {
span.save_widget {
font-size: small;
}
span.checkpoint_status,
span.autosave_status {
display: none;
}
}
@media (min-width: 768px) and (max-width: 991px) {
span.checkpoint_status {
display: none;
}
span.autosave_status {
font-size: x-small;
}
}
.toolbar {
padding: 0px;
margin-left: -5px;
margin-top: 2px;
margin-bottom: 5px;
box-sizing: border-box;
-moz-box-sizing: border-box;
-webkit-box-sizing: border-box;
}
.toolbar select,
.toolbar label {
width: auto;
vertical-align: middle;
margin-right: 2px;
margin-bottom: 0px;
display: inline;
font-size: 92%;
margin-left: 0.3em;
margin-right: 0.3em;
padding: 0px;
padding-top: 3px;
}
.toolbar .btn {
padding: 2px 8px;
}
.toolbar .btn-group {
margin-top: 0px;
margin-left: 5px;
}
#maintoolbar {
margin-bottom: -3px;
margin-top: -8px;
border: 0px;
min-height: 27px;
margin-left: 0px;
padding-top: 11px;
padding-bottom: 3px;
}
#maintoolbar .navbar-text {
float: none;
vertical-align: middle;
text-align: right;
margin-left: 5px;
margin-right: 0px;
margin-top: 0px;
}
.select-xs {
height: 24px;
}
.pulse,
.dropdown-menu > li > a.pulse,
li.pulse > a.dropdown-toggle,
li.pulse.open > a.dropdown-toggle {
background-color: #F37626;
color: white;
}
/**
* Primary styles
*
* Author: Jupyter Development Team
*/
/** WARNING IF YOU ARE EDITTING THIS FILE, if this is a .css file, It has a lot
* of chance of beeing generated from the ../less/[samename].less file, you can
* try to get back the less file by reverting somme commit in history
**/
/*
* We'll try to get something pretty, so we
* have some strange css to have the scroll bar on
* the left with fix button on the top right of the tooltip
*/
@-moz-keyframes fadeOut {
from {
opacity: 1;
}
to {
opacity: 0;
}
}
@-webkit-keyframes fadeOut {
from {
opacity: 1;
}
to {
opacity: 0;
}
}
@-moz-keyframes fadeIn {
from {
opacity: 0;
}
to {
opacity: 1;
}
}
@-webkit-keyframes fadeIn {
from {
opacity: 0;
}
to {
opacity: 1;
}
}
/*properties of tooltip after "expand"*/
.bigtooltip {
overflow: auto;
height: 200px;
-webkit-transition-property: height;
-webkit-transition-duration: 500ms;
-moz-transition-property: height;
-moz-transition-duration: 500ms;
transition-property: height;
transition-duration: 500ms;
}
/*properties of tooltip before "expand"*/
.smalltooltip {
-webkit-transition-property: height;
-webkit-transition-duration: 500ms;
-moz-transition-property: height;
-moz-transition-duration: 500ms;
transition-property: height;
transition-duration: 500ms;
text-overflow: ellipsis;
overflow: hidden;
height: 80px;
}
.tooltipbuttons {
position: absolute;
padding-right: 15px;
top: 0px;
right: 0px;
}
.tooltiptext {
/*avoid the button to overlap on some docstring*/
padding-right: 30px;
}
.ipython_tooltip {
max-width: 700px;
/*fade-in animation when inserted*/
-webkit-animation: fadeOut 400ms;
-moz-animation: fadeOut 400ms;
animation: fadeOut 400ms;
-webkit-animation: fadeIn 400ms;
-moz-animation: fadeIn 400ms;
animation: fadeIn 400ms;
vertical-align: middle;
background-color: #f7f7f7;
overflow: visible;
border: #ababab 1px solid;
outline: none;
padding: 3px;
margin: 0px;
padding-left: 7px;
font-family: monospace;
min-height: 50px;
-moz-box-shadow: 0px 6px 10px -1px #adadad;
-webkit-box-shadow: 0px 6px 10px -1px #adadad;
box-shadow: 0px 6px 10px -1px #adadad;
border-radius: 2px;
position: absolute;
z-index: 1000;
}
.ipython_tooltip a {
float: right;
}
.ipython_tooltip .tooltiptext pre {
border: 0;
border-radius: 0;
font-size: 100%;
background-color: #f7f7f7;
}
.pretooltiparrow {
left: 0px;
margin: 0px;
top: -16px;
width: 40px;
height: 16px;
overflow: hidden;
position: absolute;
}
.pretooltiparrow:before {
background-color: #f7f7f7;
border: 1px #ababab solid;
z-index: 11;
content: "";
position: absolute;
left: 15px;
top: 10px;
width: 25px;
height: 25px;
-webkit-transform: rotate(45deg);
-moz-transform: rotate(45deg);
-ms-transform: rotate(45deg);
-o-transform: rotate(45deg);
}
ul.typeahead-list i {
margin-left: -10px;
width: 18px;
}
ul.typeahead-list {
max-height: 80vh;
overflow: auto;
}
ul.typeahead-list > li > a {
/** Firefox bug **/
/* see https://github.com/jupyter/notebook/issues/559 */
white-space: normal;
}
.cmd-palette .modal-body {
padding: 7px;
}
.cmd-palette form {
background: white;
}
.cmd-palette input {
outline: none;
}
.no-shortcut {
display: none;
}
.command-shortcut:before {
content: "(command)";
padding-right: 3px;
color: #777777;
}
.edit-shortcut:before {
content: "(edit)";
padding-right: 3px;
color: #777777;
}
#find-and-replace #replace-preview .match,
#find-and-replace #replace-preview .insert {
background-color: #BBDEFB;
border-color: #90CAF9;
border-style: solid;
border-width: 1px;
border-radius: 0px;
}
#find-and-replace #replace-preview .replace .match {
background-color: #FFCDD2;
border-color: #EF9A9A;
border-radius: 0px;
}
#find-and-replace #replace-preview .replace .insert {
background-color: #C8E6C9;
border-color: #A5D6A7;
border-radius: 0px;
}
#find-and-replace #replace-preview {
max-height: 60vh;
overflow: auto;
}
#find-and-replace #replace-preview pre {
padding: 5px 10px;
}
.terminal-app {
background: #EEE;
}
.terminal-app #header {
background: #fff;
-webkit-box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.2);
}
.terminal-app .terminal {
width: 100%;
float: left;
font-family: monospace;
color: white;
background: black;
padding: 0.4em;
border-radius: 2px;
-webkit-box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.4);
box-shadow: 0px 0px 12px 1px rgba(87, 87, 87, 0.4);
}
.terminal-app .terminal,
.terminal-app .terminal dummy-screen {
line-height: 1em;
font-size: 14px;
}
.terminal-app .terminal .xterm-rows {
padding: 10px;
}
.terminal-app .terminal-cursor {
color: black;
background: white;
}
.terminal-app #terminado-container {
margin-top: 20px;
}
/*# sourceMappingURL=style.min.css.map */
</style>
<style type="text/css">
.highlight .hll { background-color: #ffffcc }
.highlight { background: #f8f8f8; }
.highlight .c { color: #408080; font-style: italic } /* Comment */
.highlight .err { border: 1px solid #FF0000 } /* Error */
.highlight .k { color: #008000; font-weight: bold } /* Keyword */
.highlight .o { color: #666666 } /* Operator */
.highlight .ch { color: #408080; font-style: italic } /* Comment.Hashbang */
.highlight .cm { color: #408080; font-style: italic } /* Comment.Multiline */
.highlight .cp { color: #BC7A00 } /* Comment.Preproc */
.highlight .cpf { color: #408080; font-style: italic } /* Comment.PreprocFile */
.highlight .c1 { color: #408080; font-style: italic } /* Comment.Single */
.highlight .cs { color: #408080; font-style: italic } /* Comment.Special */
.highlight .gd { color: #A00000 } /* Generic.Deleted */
.highlight .ge { font-style: italic } /* Generic.Emph */
.highlight .gr { color: #FF0000 } /* Generic.Error */
.highlight .gh { color: #000080; font-weight: bold } /* Generic.Heading */
.highlight .gi { color: #00A000 } /* Generic.Inserted */
.highlight .go { color: #888888 } /* Generic.Output */
.highlight .gp { color: #000080; font-weight: bold } /* Generic.Prompt */
.highlight .gs { font-weight: bold } /* Generic.Strong */
.highlight .gu { color: #800080; font-weight: bold } /* Generic.Subheading */
.highlight .gt { color: #0044DD } /* Generic.Traceback */
.highlight .kc { color: #008000; font-weight: bold } /* Keyword.Constant */
.highlight .kd { color: #008000; font-weight: bold } /* Keyword.Declaration */
.highlight .kn { color: #008000; font-weight: bold } /* Keyword.Namespace */
.highlight .kp { color: #008000 } /* Keyword.Pseudo */
.highlight .kr { color: #008000; font-weight: bold } /* Keyword.Reserved */
.highlight .kt { color: #B00040 } /* Keyword.Type */
.highlight .m { color: #666666 } /* Literal.Number */
.highlight .s { color: #BA2121 } /* Literal.String */
.highlight .na { color: #7D9029 } /* Name.Attribute */
.highlight .nb { color: #008000 } /* Name.Builtin */
.highlight .nc { color: #0000FF; font-weight: bold } /* Name.Class */
.highlight .no { color: #880000 } /* Name.Constant */
.highlight .nd { color: #AA22FF } /* Name.Decorator */
.highlight .ni { color: #999999; font-weight: bold } /* Name.Entity */
.highlight .ne { color: #D2413A; font-weight: bold } /* Name.Exception */
.highlight .nf { color: #0000FF } /* Name.Function */
.highlight .nl { color: #A0A000 } /* Name.Label */
.highlight .nn { color: #0000FF; font-weight: bold } /* Name.Namespace */
.highlight .nt { color: #008000; font-weight: bold } /* Name.Tag */
.highlight .nv { color: #19177C } /* Name.Variable */
.highlight .ow { color: #AA22FF; font-weight: bold } /* Operator.Word */
.highlight .w { color: #bbbbbb } /* Text.Whitespace */
.highlight .mb { color: #666666 } /* Literal.Number.Bin */
.highlight .mf { color: #666666 } /* Literal.Number.Float */
.highlight .mh { color: #666666 } /* Literal.Number.Hex */
.highlight .mi { color: #666666 } /* Literal.Number.Integer */
.highlight .mo { color: #666666 } /* Literal.Number.Oct */
.highlight .sa { color: #BA2121 } /* Literal.String.Affix */
.highlight .sb { color: #BA2121 } /* Literal.String.Backtick */
.highlight .sc { color: #BA2121 } /* Literal.String.Char */
.highlight .dl { color: #BA2121 } /* Literal.String.Delimiter */
.highlight .sd { color: #BA2121; font-style: italic } /* Literal.String.Doc */
.highlight .s2 { color: #BA2121 } /* Literal.String.Double */
.highlight .se { color: #BB6622; font-weight: bold } /* Literal.String.Escape */
.highlight .sh { color: #BA2121 } /* Literal.String.Heredoc */
.highlight .si { color: #BB6688; font-weight: bold } /* Literal.String.Interpol */
.highlight .sx { color: #008000 } /* Literal.String.Other */
.highlight .sr { color: #BB6688 } /* Literal.String.Regex */
.highlight .s1 { color: #BA2121 } /* Literal.String.Single */
.highlight .ss { color: #19177C } /* Literal.String.Symbol */
.highlight .bp { color: #008000 } /* Name.Builtin.Pseudo */
.highlight .fm { color: #0000FF } /* Name.Function.Magic */
.highlight .vc { color: #19177C } /* Name.Variable.Class */
.highlight .vg { color: #19177C } /* Name.Variable.Global */
.highlight .vi { color: #19177C } /* Name.Variable.Instance */
.highlight .vm { color: #19177C } /* Name.Variable.Magic */
.highlight .il { color: #666666 } /* Literal.Number.Integer.Long */
</style>
<style type="text/css">
/* Temporary definitions which will become obsolete with Notebook release 5.0 */
.ansi-black-fg { color: #3E424D; }
.ansi-black-bg { background-color: #3E424D; }
.ansi-black-intense-fg { color: #282C36; }
.ansi-black-intense-bg { background-color: #282C36; }
.ansi-red-fg { color: #E75C58; }
.ansi-red-bg { background-color: #E75C58; }
.ansi-red-intense-fg { color: #B22B31; }
.ansi-red-intense-bg { background-color: #B22B31; }
.ansi-green-fg { color: #00A250; }
.ansi-green-bg { background-color: #00A250; }
.ansi-green-intense-fg { color: #007427; }
.ansi-green-intense-bg { background-color: #007427; }
.ansi-yellow-fg { color: #DDB62B; }
.ansi-yellow-bg { background-color: #DDB62B; }
.ansi-yellow-intense-fg { color: #B27D12; }
.ansi-yellow-intense-bg { background-color: #B27D12; }
.ansi-blue-fg { color: #208FFB; }
.ansi-blue-bg { background-color: #208FFB; }
.ansi-blue-intense-fg { color: #0065CA; }
.ansi-blue-intense-bg { background-color: #0065CA; }
.ansi-magenta-fg { color: #D160C4; }
.ansi-magenta-bg { background-color: #D160C4; }
.ansi-magenta-intense-fg { color: #A03196; }
.ansi-magenta-intense-bg { background-color: #A03196; }
.ansi-cyan-fg { color: #60C6C8; }
.ansi-cyan-bg { background-color: #60C6C8; }
.ansi-cyan-intense-fg { color: #258F8F; }
.ansi-cyan-intense-bg { background-color: #258F8F; }
.ansi-white-fg { color: #C5C1B4; }
.ansi-white-bg { background-color: #C5C1B4; }
.ansi-white-intense-fg { color: #A1A6B2; }
.ansi-white-intense-bg { background-color: #A1A6B2; }
.ansi-bold { font-weight: bold; }
</style>
<style type="text/css">
/* Overrides of notebook CSS for static HTML export */
body {
overflow: visible;
padding: 8px;
}
div#notebook {
overflow: visible;
border-top: none;
}
@media print {
div.cell {
display: block;
page-break-inside: avoid;
}
div.output_wrapper {
display: block;
page-break-inside: avoid;
}
div.output {
display: block;
page-break-inside: avoid;
}
}
</style>
<!-- Custom stylesheet, it must be in the same directory as the html file -->
<link rel="stylesheet" href="custom.css">
<!-- Loading mathjax macro -->
<!-- Load mathjax -->
<script src="https://cdn.mathjax.org/mathjax/latest/MathJax.js?config=TeX-AMS_HTML"></script>
<!-- MathJax configuration -->
<script type="text/x-mathjax-config">
MathJax.Hub.Config({
tex2jax: {
inlineMath: [ ['$','$'], ["\\(","\\)"] ],
displayMath: [ ['$$','$$'], ["\\[","\\]"] ],
processEscapes: true,
processEnvironments: true
},
// Center justify equations in code and markdown cells. Elsewhere
// we use CSS to left justify single line equations in code cells.
displayAlign: 'center',
"HTML-CSS": {
styles: {'.MathJax_Display': {"margin": 0}},
linebreaks: { automatic: true }
}
});
</script>
<!-- End of mathjax configuration --></head>
<body>
<div tabindex="-1" id="notebook" class="border-box-sizing">
<div class="container" id="notebook-container">
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h1 id="AutoML:-Automatic-Machine-Learning">AutoML: Automatic Machine Learning<a class="anchor-link" href="#AutoML:-Automatic-Machine-Learning">&#182;</a></h1><p>AutoML: Automatic Machine Learning</p>
<p>H2O’s AutoML is used for automating the machine learning workflow, which includes automatic training and tuning of many models within a user-specified time-limit. Stacked Ensembles will be automatically trained on collections of individual models to produce highly predictive ensemble models which, in most cases, will be the top performing models in the AutoML Leaderboard.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Tutorials">Tutorials<a class="anchor-link" href="#Tutorials">&#182;</a></h2><ul>
<li>Intro to AutoML + Hands-on Lab - Erin LeDell, Machine Learning Scientist... <a href="https://youtu.be/42Oo8TOl85I">https://youtu.be/42Oo8TOl85I</a> </li>
<li><p>Scalable Automatic Machine Learning in H2O <a href="https://youtu.be/j6rqrEYQNdo">https://youtu.be/j6rqrEYQNdo</a></p>
</li>
<li><p>Scalable Automatic Machine Learning in H2O <a href="https://youtu.be/j6rqrEYQNdo">https://youtu.be/j6rqrEYQNdo</a></p>
</li>
</ul>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Installing-H2O-and-h2o-python">Installing H2O and h2o python<a class="anchor-link" href="#Installing-H2O-and-h2o-python">&#182;</a></h2><p>See <a href="http://docs.h2o.ai/h2o/latest-stable/h2o-docs/downloading.html">http://docs.h2o.ai/h2o/latest-stable/h2o-docs/downloading.html</a></p>
<p>Click the Download H2O button on the <a href="http://h2o-release.s3.amazonaws.com/h2o/latest_stable.html">http://h2o-release.s3.amazonaws.com/h2o/latest_stable.html</a> page. This downloads a zip file that contains everything you need to get started.</p>
<div class="highlight"><pre><span></span><span class="nb">cd</span> ~/Downloads
unzip h2o-3.20.0.1.zip
<span class="nb">cd</span> h2o-3.20.0.1
java -jar h2o.jar
</pre></div>
<p>Point your browser to <a href="http://localhost:54321">http://localhost:54321</a>.</p>
<p><strong>Install in Python</strong></p>
<p>Install dependencies (prepending with sudo if needed):</p>
<div class="highlight"><pre><span></span>pip install requests
pip install tabulate
pip install scikit-learn
pip install colorama
pip install future
</pre></div>
<p>Remove any existing H2O module for Python.</p>
<div class="highlight"><pre><span></span>pip uninstall h2o
</pre></div>
<p>Use pip to install this version of the H2O Python module.</p>
<div class="highlight"><pre><span></span>pip install -f http://h2o-release.s3.amazonaws.com/h2o/latest_stable_Py.html h2o
</pre></div>
<p>Note: When installing H2O from pip in OS X El Capitan, users must include the --user flag. For example:</p>
<div class="highlight"><pre><span></span>pip install -f http://h2o-release.s3.amazonaws.com/h2o/latest_stable_Py.html h2o --user
</pre></div>
<p>Initialize H2O in Python and run a demo to see H2O at work.</p>
<div class="highlight"><pre><span></span><span class="n">python</span>
<span class="kn">import</span> <span class="nn">h2o</span>
<span class="n">h2o</span><span class="o">.</span><span class="n">init</span><span class="p">()</span>
<span class="n">h2o</span><span class="o">.</span><span class="n">demo</span><span class="p">(</span><span class="s2">&quot;glm&quot;</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Saving-data">Saving data<a class="anchor-link" href="#Saving-data">&#182;</a></h2><p>H2O model file file will be saved in one of two formats.</p>
<p>There are two ways to save the leader model -- binary format and MOJO format. If you're taking your leader model to production, then we'd suggest the MOJO format since it's optimized for production use.</p>
<p>See <a href="http://docs.h2o.ai/h2o/latest-stable/h2o-docs/save-and-load-model.html">http://docs.h2o.ai/h2o/latest-stable/h2o-docs/save-and-load-model.html</a></p>
<div class="highlight"><pre><span></span><span class="c1"># save the model</span>
<span class="n">model_path</span> <span class="o">=</span> <span class="n">h2o</span><span class="o">.</span><span class="n">save_model</span><span class="p">(</span><span class="n">model</span><span class="o">=</span><span class="n">model</span><span class="p">,</span> <span class="n">path</span><span class="o">=</span><span class="s2">&quot;/tmp/mymodel&quot;</span><span class="p">,</span> <span class="n">force</span><span class="o">=</span><span class="bp">True</span><span class="p">)</span>
<span class="c1"># or</span>
<span class="n">h2o</span><span class="o">.</span><span class="n">save_model</span><span class="p">(</span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="p">,</span> <span class="n">path</span> <span class="o">=</span> <span class="s2">&quot;./models&quot;</span><span class="p">)</span>
<span class="c1"># or</span>
<span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">download_mojo</span><span class="p">(</span><span class="n">path</span> <span class="o">=</span> <span class="s2">&quot;./models&quot;</span><span class="p">)</span>
<span class="c1"># load the model</span>
<span class="n">saved_model</span> <span class="o">=</span> <span class="n">h2o</span><span class="o">.</span><span class="n">load_model</span><span class="p">(</span><span class="n">model_path</span><span class="p">)</span>
</pre></div>
<p><strong>Saving data from runs</strong></p>
<p>Stats about the models can be saved as text or csv or put directly in a database.</p>
<p>Much of the data is gathered by converting H2O objects to pandas data frame. So anything that a pandas data frame can be saved as is supported.
<a href="https://pandas.pydata.org/pandas-docs/stable/generated/pandas.DataFrame.html">https://pandas.pydata.org/pandas-docs/stable/generated/pandas.DataFrame.html</a></p>
<div class="highlight"><pre><span></span><span class="n">data_pd</span> <span class="o">=</span> <span class="nb">object</span><span class="o">.</span><span class="n">as_data_frame</span><span class="p">(</span><span class="n">use_pandas</span><span class="o">=</span><span class="bp">True</span><span class="p">)</span>
</pre></div>
<p>Otherwise data is returned as python dictionaries or lists.</p>
<div class="highlight"><pre><span></span><span class="p">[(</span><span class="s1">&#39;addr_state&#39;</span><span class="p">,</span> <span class="mf">258199.28125</span><span class="p">,</span> <span class="mf">1.0</span><span class="p">,</span> <span class="mf">0.19965953057652525</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;int_rate&#39;</span><span class="p">,</span> <span class="mf">203347.0625</span><span class="p">,</span> <span class="mf">0.7875585924002257</span><span class="p">,</span> <span class="mf">0.15724357886013807</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;dti&#39;</span><span class="p">,</span> <span class="mf">116477.5703125</span><span class="p">,</span> <span class="mf">0.45111500600856147</span><span class="p">,</span> <span class="mf">0.09006941033569575</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;revol_util&#39;</span><span class="p">,</span> <span class="mf">110586.1484375</span><span class="p">,</span> <span class="mf">0.42829766179877776</span><span class="p">,</span> <span class="mf">0.08551371010176734</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;annual_inc&#39;</span><span class="p">,</span> <span class="mf">96993.90625</span><span class="p">,</span> <span class="mf">0.3756552139898724</span><span class="p">,</span> <span class="mf">0.07500314368384206</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;loan_amnt&#39;</span><span class="p">,</span> <span class="mf">95294.5</span><span class="p">,</span> <span class="mf">0.36907345186500207</span><span class="p">,</span> <span class="mf">0.0736890321476241</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;total_acc&#39;</span><span class="p">,</span> <span class="mf">90064.8046875</span><span class="p">,</span> <span class="mf">0.3488189597255124</span><span class="p">,</span> <span class="mf">0.06964502975498767</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;longest_credit_length&#39;</span><span class="p">,</span> <span class="mf">84291.921875</span><span class="p">,</span> <span class="mf">0.3264607146345416</span><span class="p">,</span> <span class="mf">0.06518099303560954</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;purpose&#39;</span><span class="p">,</span> <span class="mf">77462.203125</span><span class="p">,</span> <span class="mf">0.30000936776426446</span><span class="p">,</span> <span class="mf">0.05989972953637317</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;emp_length&#39;</span><span class="p">,</span> <span class="mf">63839.28125</span><span class="p">,</span> <span class="mf">0.24724809821677224</span><span class="p">,</span> <span class="mf">0.04936543922589935</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;term&#39;</span><span class="p">,</span> <span class="mf">34895.7265625</span><span class="p">,</span> <span class="mf">0.1351503629040408</span><span class="p">,</span> <span class="mf">0.02698405801466782</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;home_ownership&#39;</span><span class="p">,</span> <span class="mf">26499.876953125</span><span class="p">,</span> <span class="mf">0.10263342649457897</span><span class="p">,</span> <span class="mf">0.02049174175536795</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;delinq_2yrs&#39;</span><span class="p">,</span> <span class="mf">20556.2578125</span><span class="p">,</span> <span class="mf">0.0796139234508423</span><span class="p">,</span> <span class="mf">0.015895678583550586</span><span class="p">),</span> <span class="p">(</span><span class="s1">&#39;verification_status&#39;</span><span class="p">,</span> <span class="mf">14689.3369140625</span><span class="p">,</span> <span class="mf">0.056891470971368166</span><span class="p">,</span> <span class="mf">0.01135892438795138</span><span class="p">)]</span>
</pre></div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Starting-H2O-server">Starting H2O server<a class="anchor-link" href="#Starting-H2O-server">&#182;</a></h2>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[65]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># import h2o package and specific estimator </span>
<span class="kn">import</span> <span class="nn">h2o</span>
<span class="kn">from</span> <span class="nn">h2o.automl</span> <span class="k">import</span> <span class="n">H2OAutoML</span>
</pre></div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>h2o.init with python seems very sensitive the the H2O version. If the H2O cluster version is 3.20.0.1 and the python h2o library is 3.19.0 it will fail so we set strict_version_check=False</p>
<p>If the H2O cluster isn't found h2o.init will start one.</p>
<p>Note that the current script starts each H2O instance on a different port. It's not clear why but should we do this we should choose from only the higher ports.</p>
<p>A port number is a 16-bit unsigned integer, thus ranging from 0 to 65535. There is no reason to choose a port less than 10000.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[66]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">h2o</span><span class="o">.</span><span class="n">init</span><span class="p">(</span><span class="n">strict_version_check</span><span class="o">=</span><span class="kc">False</span><span class="p">)</span> <span class="c1"># start h2o</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Checking whether there is an H2O instance running at http://localhost:54321. connected.
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td>H2O cluster uptime:</td>
<td>10 mins 06 secs</td></tr>
<tr><td>H2O cluster timezone:</td>
<td>America/New_York</td></tr>
<tr><td>H2O data parsing timezone:</td>
<td>UTC</td></tr>
<tr><td>H2O cluster version:</td>
<td>3.20.0.1</td></tr>
<tr><td>H2O cluster version age:</td>
<td>5 months and 13 days !!!</td></tr>
<tr><td>H2O cluster name:</td>
<td>H2O_from_python_bear_07058y</td></tr>
<tr><td>H2O cluster total nodes:</td>
<td>1</td></tr>
<tr><td>H2O cluster free memory:</td>
<td>2.129 Gb</td></tr>
<tr><td>H2O cluster total cores:</td>
<td>8</td></tr>
<tr><td>H2O cluster allowed cores:</td>
<td>8</td></tr>
<tr><td>H2O cluster status:</td>
<td>locked, healthy</td></tr>
<tr><td>H2O connection url:</td>
<td>http://localhost:54321</td></tr>
<tr><td>H2O connection proxy:</td>
<td>None</td></tr>
<tr><td>H2O internal security:</td>
<td>False</td></tr>
<tr><td>H2O API Extensions:</td>
<td>XGBoost, Algos, AutoML, Core V3, Core V4</td></tr>
<tr><td>Python version:</td>
<td>3.6.5 final</td></tr></table></div>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="h2o.automl-Parameters">h2o.automl Parameters<a class="anchor-link" href="#h2o.automl-Parameters">&#182;</a></h2><p><a href="http://docs.h2o.ai/h2o/latest-stable/h2o-docs/automl.html">http://docs.h2o.ai/h2o/latest-stable/h2o-docs/automl.html</a></p>
<p>NB: Eventually one wants to expose all the parameters to the expert user.</p>
<p><strong>Required Data Parameters</strong></p>
<p>y: This argument is the name (or index) of the response column.</p>
<p>training_frame: Specifies the training set.</p>
<p>The user gives the name of the depenent variable and training file name.</p>
<p><strong>Required Stopping Parameters</strong></p>
<p>One of the following stopping strategies (time or number-of-model based) must be specified. When both options are set, then the AutoML run will stop as soon as it hits one of either of these limits.</p>
<p>max_runtime_secs: This argument controls how long the AutoML run will execute for. This defaults to 3600 seconds (1 hour).</p>
<p>max_models: Specify the maximum number of models to build in an AutoML run, excluding the Stacked Ensemble models. Defaults to NULL/None.</p>
<h3 id="Optional-Parameters">Optional Parameters<a class="anchor-link" href="#Optional-Parameters">&#182;</a></h3><p><strong>Optional Data Parameters</strong></p>
<p>x: A list/vector of predictor column names or indexes. This argument only needs to be specified if the user wants to exclude columns from the set of predictors. If all columns (other than the response) should be used in prediction, then this does not need to be set.</p>
<p>validation_frame: This argument is used to specify the validation frame used for early stopping of individual models and early stopping of the grid searches (unless max_models or max_runtime_secs overrides metric-based early stopping).</p>
<p>leaderboard_frame: This argument allows the user to specify a particular data frame use to score &amp; rank models on the leaderboard. This frame will not be used for anything besides leaderboard scoring. If a leaderboard frame is not specified by the user, then the leaderboard will use cross-validation metrics instead (or if cross-validation is turned off by setting nfolds = 0, then a leaderboard frame will be generated automatically from the validation frame (if provided) or the training frame).</p>
<p>fold_column: Specifies a column with cross-validation fold index assignment per observation. This is used to override the default, randomized, 5-fold cross-validation scheme for individual models in the AutoML run.</p>
<p>weights_column: Specifies a column with observation weights. Giving some observation a weight of zero is equivalent to excluding it from the dataset; giving an observation a relative weight of 2 is equivalent to repeating that row twice. Negative weights are not allowed.</p>
<p>ignored_columns: (Optional, Python only) Specify the column or columns (as a list/vector) to be excluded from the model. This is the converse of the x argument.</p>
<p><strong>Optional Miscellaneous Parameters</strong></p>
<p>nfolds: Number of folds for k-fold cross-validation of the models in the AutoML run. Defaults to 5. Use 0 to disable cross-validation; this will also disable Stacked Ensembles (thus decreasing the overall best model performance).</p>
<p>balance_classes: Specify whether to oversample the minority classes to balance the class distribution. This option is not enabled by default and can increase the data frame size. This option is only applicable for classification. Majority classes can be undersampled to satisfy the max_after_balance_size parameter.</p>
<p>class_sampling_factors: Specify the per-class (in lexicographical order) over/under-sampling ratios. By default, these ratios are automatically computed during training to obtain the class balance.</p>
<p>max_after_balance_size: Specify the maximum relative size of the training data after balancing class counts (balance_classes must be enabled). Defaults to 5.0. (The value can be less than 1.0).</p>
<p>stopping_metric: Specifies the metric to use for early stopping of the grid searches and individual models. Defaults to "AUTO". The available options are:</p>
<p>AUTO: This defaults to logloss for classification, deviance for regression
deviance (mean residual deviance)
logloss
MSE
RMSE
MAE
RMSLE
AUC
lift_top_group
misclassification
mean_per_class_error</p>
<p>stopping_tolerance: This option specifies the relative tolerance for the metric-based stopping criterion to stop a grid search and the training of individual models within the AutoML run. This value defaults to 0.001 if the dataset is at least 1 million rows; otherwise it defaults to a bigger value determined by the size of the dataset and the non-NA-rate. In that case, the value is computed as 1/sqrt(nrows * non-NA-rate).</p>
<p>stopping_rounds: This argument is used to stop model training when the stopping metric (e.g. AUC) doesn’t improve for this specified number of training rounds, based on a simple moving average. In the context of AutoML, this controls early stopping both within the random grid searches as well as the individual models. Defaults to 3 and must be an non-negative integer. To disable early stopping altogether, set this to 0.</p>
<p>sort_metric: Specifies the metric used to sort the Leaderboard by at the end of an AutoML run. Available options include:</p>
<p>AUTO: This defaults to AUC for binary classification, mean_per_class_error for multinomial classification, and deviance for regression.
deviance (mean residual deviance)
logloss
MSE
RMSE
MAE
RMSLE
AUC
mean_per_class_error</p>
<p>seed: Integer. Set a seed for reproducibility. AutoML can only guarantee reproducibility if max_models is used because max_runtime_secs is resource limited, meaning that if the available compute resources are not the same between runs, AutoML may be able to train more models on one run vs another. Defaults to NULL/None.</p>
<p>project_name: Character string to identify an AutoML project. Defaults to NULL/None, which means a project name will be auto-generated based on the training frame ID. More models can be trained and added to an existing AutoML project by specifying the same project name in muliple calls to the AutoML function (as long as the same training frame is used in subsequent runs).</p>
<p>exclude_algos: List/vector of character strings naming the algorithms to skip during the model-building phase. An example use is exclude_algos = ["GLM", "DeepLearning", "DRF"] in Python or exclude_algos = c("GLM", "DeepLearning", "DRF") in R. Defaults to None/NULL, which means that all appropriate H2O algorithms will be used, if the search stopping criteria allow. The algorithm names are:</p>
<p>GLM
DeepLearning
GBM
DRF (This includes both the Random Forest and Extremely Randomized Trees (XRT) models. Refer to the Extremely Randomized Trees section in the DRF chapter and the histogram_type parameter description for more information.)
StackedEnsemble
keep_cross_validation_predictions: Specify whether to keep the predictions of the cross-validation predictions. If set to FALSE, then running the same AutoML object for repeated runs will cause an exception because CV predictions are are required to build additional Stacked Ensemble models in AutoML. This option defaults to TRUE.</p>
<p>keep_cross_validation_models: Specify whether to keep the cross-validated models. Deleting cross-validation models will save memory in the H2O cluster. This option defaults to TRUE.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[67]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># Assume the following are passed by the user from the web interface</span>
<span class="sd">&#39;&#39;&#39;</span>
<span class="sd">Need a user id and project id?</span>
<span class="sd">&#39;&#39;&#39;</span>
<span class="n">target</span><span class="o">=</span><span class="s1">&#39;bad_loan&#39;</span>
<span class="n">data_file</span><span class="o">=</span><span class="s1">&#39;loan.csv&#39;</span>
<span class="n">run_time</span><span class="o">=</span><span class="mi">333</span>
<span class="n">run_id</span><span class="o">=</span><span class="s1">&#39;SOME_ID_20180617_221529&#39;</span> <span class="c1"># Just some arbitrary ID</span>
<span class="n">server_path</span><span class="o">=</span><span class="s1">&#39;/Users/bear/Documents/INFO_7390/H2O&#39;</span>
<span class="n">classification</span><span class="o">=</span><span class="kc">True</span>
<span class="n">scale</span><span class="o">=</span><span class="kc">False</span>
<span class="n">max_models</span><span class="o">=</span><span class="kc">None</span>
<span class="n">balance_y</span><span class="o">=</span><span class="kc">False</span> <span class="c1"># balance_classes=balance_y</span>
<span class="n">balance_threshold</span><span class="o">=</span><span class="mf">0.2</span>
<span class="n">project</span> <span class="o">=</span><span class="s2">&quot;automl_test&quot;</span> <span class="c1"># project_name = project</span>
</pre></div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[68]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># Use local data file or download from some type of bucket</span>
<span class="kn">import</span> <span class="nn">os</span>
<span class="n">data_path</span><span class="o">=</span><span class="n">os</span><span class="o">.</span><span class="n">path</span><span class="o">.</span><span class="n">join</span><span class="p">(</span><span class="n">server_path</span><span class="p">,</span><span class="n">data_file</span><span class="p">)</span>
<span class="n">data_path</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[68]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&#39;/Users/bear/Documents/INFO_7390/H2O/loan.csv&#39;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[69]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># Use local data file or download from some type of bucket</span>
<span class="k">if</span> <span class="ow">not</span> <span class="n">os</span><span class="o">.</span><span class="n">path</span><span class="o">.</span><span class="n">isfile</span><span class="p">(</span><span class="n">data_path</span><span class="p">):</span>
<span class="n">data_path</span> <span class="o">=</span> <span class="s1">&#39;https://raw.githubusercontent.com/h2oai/app-consumer-loan/master/data/loan.csv&#39;</span>
<span class="c1"># Load data into H2O</span>
<span class="n">df</span> <span class="o">=</span> <span class="n">h2o</span><span class="o">.</span><span class="n">import_file</span><span class="p">(</span><span class="n">data_path</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Parse progress: |█████████████████████████████████████████████████████████| 100%
</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[70]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">df</span><span class="o">.</span><span class="n">describe</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Rows:163987
Cols:15
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<table>
<thead>
<tr><th> </th><th>loan_amnt </th><th>term </th><th>int_rate </th><th>emp_length </th><th>home_ownership </th><th>annual_inc </th><th>purpose </th><th>addr_state </th><th>dti </th><th>delinq_2yrs </th><th>revol_util </th><th>total_acc </th><th>bad_loan </th><th>longest_credit_length </th><th>verification_status </th></tr>
</thead>
<tbody>
<tr><td>type </td><td>int </td><td>enum </td><td>real </td><td>int </td><td>enum </td><td>real </td><td>enum </td><td>enum </td><td>real </td><td>int </td><td>real </td><td>int </td><td>int </td><td>int </td><td>enum </td></tr>
<tr><td>mins </td><td>500.0 </td><td> </td><td>5.42 </td><td>0.0 </td><td> </td><td>1896.0 </td><td> </td><td> </td><td>0.0 </td><td>0.0 </td><td>0.0 </td><td>1.0 </td><td>0.0 </td><td>0.0 </td><td> </td></tr>
<tr><td>mean </td><td>13074.169141456332</td><td> </td><td>13.715904065566189</td><td>5.684352932995338</td><td> </td><td>71915.67051974905</td><td> </td><td> </td><td>15.881530121290167</td><td>0.22735700606252723</td><td>54.07917280242262 </td><td>24.579733834274574</td><td>0.1830388994249544</td><td>14.854273655448333 </td><td> </td></tr>
<tr><td>maxs </td><td>35000.0 </td><td> </td><td>26.06 </td><td>10.0 </td><td> </td><td>7141778.0 </td><td> </td><td> </td><td>39.99 </td><td>29.0 </td><td>150.70000000000002</td><td>118.0 </td><td>1.0 </td><td>65.0 </td><td> </td></tr>
<tr><td>sigma </td><td>7993.556188734672 </td><td> </td><td>4.391939870545808 </td><td>3.610663731100238</td><td> </td><td>59070.91565491818</td><td> </td><td> </td><td>7.5876682241925355</td><td>0.6941679229284191 </td><td>25.285366766770498</td><td>11.685190365910666</td><td>0.3866995896078875</td><td>6.947732922546689 </td><td> </td></tr>
<tr><td>zeros </td><td>0 </td><td> </td><td>0 </td><td>14248 </td><td> </td><td>0 </td><td> </td><td> </td><td>270 </td><td>139459 </td><td>1562 </td><td>0 </td><td>133971 </td><td>11 </td><td> </td></tr>
<tr><td>missing</td><td>0 </td><td>0 </td><td>0 </td><td>5804 </td><td>0 </td><td>4 </td><td>0 </td><td>0 </td><td>0 </td><td>29 </td><td>193 </td><td>29 </td><td>0 </td><td>29 </td><td>0 </td></tr>
<tr><td>0 </td><td>5000.0 </td><td>36 months</td><td>10.65 </td><td>10.0 </td><td>RENT </td><td>24000.0 </td><td>credit_card </td><td>AZ </td><td>27.65 </td><td>0.0 </td><td>83.7 </td><td>9.0 </td><td>0.0 </td><td>26.0 </td><td>verified </td></tr>
<tr><td>1 </td><td>2500.0 </td><td>60 months</td><td>15.27 </td><td>0.0 </td><td>RENT </td><td>30000.0 </td><td>car </td><td>GA </td><td>1.0 </td><td>0.0 </td><td>9.4 </td><td>4.0 </td><td>1.0 </td><td>12.0 </td><td>verified </td></tr>
<tr><td>2 </td><td>2400.0 </td><td>36 months</td><td>15.96 </td><td>10.0 </td><td>RENT </td><td>12252.0 </td><td>small_business </td><td>IL </td><td>8.72 </td><td>0.0 </td><td>98.5 </td><td>10.0 </td><td>0.0 </td><td>10.0 </td><td>not verified </td></tr>
<tr><td>3 </td><td>10000.0 </td><td>36 months</td><td>13.49 </td><td>10.0 </td><td>RENT </td><td>49200.0 </td><td>other </td><td>CA </td><td>20.0 </td><td>0.0 </td><td>21.0 </td><td>37.0 </td><td>0.0 </td><td>15.0 </td><td>verified </td></tr>
<tr><td>4 </td><td>5000.0 </td><td>36 months</td><td>7.9 </td><td>3.0 </td><td>RENT </td><td>36000.0 </td><td>wedding </td><td>AZ </td><td>11.2 </td><td>0.0 </td><td>28.3 </td><td>12.0 </td><td>0.0 </td><td>7.0 </td><td>verified </td></tr>
<tr><td>5 </td><td>3000.0 </td><td>36 months</td><td>18.64 </td><td>9.0 </td><td>RENT </td><td>48000.0 </td><td>car </td><td>CA </td><td>5.3500000000000005</td><td>0.0 </td><td>87.5 </td><td>4.0 </td><td>0.0 </td><td>4.0 </td><td>verified </td></tr>
<tr><td>6 </td><td>5600.0 </td><td>60 months</td><td>21.28 </td><td>4.0 </td><td>OWN </td><td>40000.0 </td><td>small_business </td><td>CA </td><td>5.55 </td><td>0.0 </td><td>32.6 </td><td>13.0 </td><td>1.0 </td><td>7.0 </td><td>verified </td></tr>
<tr><td>7 </td><td>5375.0 </td><td>60 months</td><td>12.69 </td><td>0.0 </td><td>RENT </td><td>15000.0 </td><td>other </td><td>TX </td><td>18.08 </td><td>0.0 </td><td>36.5 </td><td>3.0 </td><td>1.0 </td><td>7.0 </td><td>verified </td></tr>
<tr><td>8 </td><td>6500.0 </td><td>60 months</td><td>14.65 </td><td>5.0 </td><td>OWN </td><td>72000.0 </td><td>debt_consolidation</td><td>AZ </td><td>16.12 </td><td>0.0 </td><td>20.6 </td><td>23.0 </td><td>0.0 </td><td>13.0 </td><td>not verified </td></tr>
<tr><td>9 </td><td>12000.0 </td><td>36 months</td><td>12.69 </td><td>10.0 </td><td>OWN </td><td>75000.0 </td><td>debt_consolidation</td><td>CA </td><td>10.78 </td><td>0.0 </td><td>67.10000000000001 </td><td>34.0 </td><td>0.0 </td><td>22.0 </td><td>verified </td></tr>
</tbody>
</table>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[71]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># assign target and inputs for logistic regression</span>
<span class="n">y</span> <span class="o">=</span> <span class="n">target</span>
<span class="n">X</span> <span class="o">=</span> <span class="p">[</span><span class="n">name</span> <span class="k">for</span> <span class="n">name</span> <span class="ow">in</span> <span class="n">df</span><span class="o">.</span><span class="n">columns</span> <span class="k">if</span> <span class="n">name</span> <span class="o">!=</span> <span class="n">y</span><span class="p">]</span>
<span class="nb">print</span><span class="p">(</span><span class="n">y</span><span class="p">)</span>
<span class="nb">print</span><span class="p">(</span><span class="n">X</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>bad_loan
[&#39;loan_amnt&#39;, &#39;term&#39;, &#39;int_rate&#39;, &#39;emp_length&#39;, &#39;home_ownership&#39;, &#39;annual_inc&#39;, &#39;purpose&#39;, &#39;addr_state&#39;, &#39;dti&#39;, &#39;delinq_2yrs&#39;, &#39;revol_util&#39;, &#39;total_acc&#39;, &#39;longest_credit_length&#39;, &#39;verification_status&#39;]
</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[72]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># determine column types</span>
<span class="n">ints</span><span class="p">,</span> <span class="n">reals</span><span class="p">,</span> <span class="n">enums</span> <span class="o">=</span> <span class="p">[],</span> <span class="p">[],</span> <span class="p">[]</span>
<span class="k">for</span> <span class="n">key</span><span class="p">,</span> <span class="n">val</span> <span class="ow">in</span> <span class="n">df</span><span class="o">.</span><span class="n">types</span><span class="o">.</span><span class="n">items</span><span class="p">():</span>
<span class="k">if</span> <span class="n">key</span> <span class="ow">in</span> <span class="n">X</span><span class="p">:</span>
<span class="k">if</span> <span class="n">val</span> <span class="o">==</span> <span class="s1">&#39;enum&#39;</span><span class="p">:</span>
<span class="n">enums</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">key</span><span class="p">)</span>
<span class="k">elif</span> <span class="n">val</span> <span class="o">==</span> <span class="s1">&#39;int&#39;</span><span class="p">:</span>
<span class="n">ints</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">key</span><span class="p">)</span>
<span class="k">else</span><span class="p">:</span>
<span class="n">reals</span><span class="o">.</span><span class="n">append</span><span class="p">(</span><span class="n">key</span><span class="p">)</span>
<span class="nb">print</span><span class="p">(</span><span class="n">ints</span><span class="p">)</span>
<span class="nb">print</span><span class="p">(</span><span class="n">enums</span><span class="p">)</span>
<span class="nb">print</span><span class="p">(</span><span class="n">reals</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>[&#39;loan_amnt&#39;, &#39;emp_length&#39;, &#39;delinq_2yrs&#39;, &#39;total_acc&#39;, &#39;longest_credit_length&#39;]
[&#39;term&#39;, &#39;home_ownership&#39;, &#39;purpose&#39;, &#39;addr_state&#39;, &#39;verification_status&#39;]
[&#39;int_rate&#39;, &#39;annual_inc&#39;, &#39;dti&#39;, &#39;revol_util&#39;]
</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[73]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># impute missing values</span>
<span class="n">_</span> <span class="o">=</span> <span class="n">df</span><span class="p">[</span><span class="n">reals</span><span class="p">]</span><span class="o">.</span><span class="n">impute</span><span class="p">(</span><span class="n">method</span><span class="o">=</span><span class="s1">&#39;mean&#39;</span><span class="p">)</span>
<span class="n">_</span> <span class="o">=</span> <span class="n">df</span><span class="p">[</span><span class="n">ints</span><span class="p">]</span><span class="o">.</span><span class="n">impute</span><span class="p">(</span><span class="n">method</span><span class="o">=</span><span class="s1">&#39;median&#39;</span><span class="p">)</span>
<span class="k">if</span> <span class="n">scale</span><span class="p">:</span>
<span class="n">df</span><span class="p">[</span><span class="n">reals</span><span class="p">]</span> <span class="o">=</span> <span class="n">df</span><span class="p">[</span><span class="n">reals</span><span class="p">]</span><span class="o">.</span><span class="n">scale</span><span class="p">()</span>
<span class="n">df</span><span class="p">[</span><span class="n">ints</span><span class="p">]</span> <span class="o">=</span> <span class="n">df</span><span class="p">[</span><span class="n">ints</span><span class="p">]</span><span class="o">.</span><span class="n">scale</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[74]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># set target to factor for classification by default or if user specifies classification</span>
<span class="k">if</span> <span class="n">classification</span><span class="p">:</span>
<span class="n">df</span><span class="p">[</span><span class="n">y</span><span class="p">]</span> <span class="o">=</span> <span class="n">df</span><span class="p">[</span><span class="n">y</span><span class="p">]</span><span class="o">.</span><span class="n">asfactor</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[75]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">df</span><span class="p">[</span><span class="n">y</span><span class="p">]</span><span class="o">.</span><span class="n">levels</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[75]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>[[&#39;0&#39;, &#39;1&#39;]]</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h3 id="balance_classes-check">balance_classes check<a class="anchor-link" href="#balance_classes-check">&#182;</a></h3><p>If one class in two class classification is less than 20% of the total then one should set balance_classes=True</p>
<p>That is,</p>
<p>balance_classes=balance_y</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[76]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="k">if</span> <span class="n">classification</span><span class="p">:</span>
<span class="n">class_percentage</span> <span class="o">=</span> <span class="n">y_balance</span><span class="o">=</span><span class="n">df</span><span class="p">[</span><span class="n">y</span><span class="p">]</span><span class="o">.</span><span class="n">mean</span><span class="p">()[</span><span class="mi">0</span><span class="p">]</span><span class="o">/</span><span class="p">(</span><span class="n">df</span><span class="p">[</span><span class="n">y</span><span class="p">]</span><span class="o">.</span><span class="n">max</span><span class="p">()</span><span class="o">-</span><span class="n">df</span><span class="p">[</span><span class="n">y</span><span class="p">]</span><span class="o">.</span><span class="n">min</span><span class="p">())</span>
<span class="k">if</span> <span class="n">class_percentage</span> <span class="o">&lt;</span> <span class="n">balance_threshold</span><span class="p">:</span>
<span class="n">balance_y</span><span class="o">=</span><span class="kc">True</span>
</pre></div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[77]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="nb">print</span><span class="p">(</span><span class="n">run_time</span><span class="p">)</span>
<span class="nb">type</span><span class="p">(</span><span class="n">run_time</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>333
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[77]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>int</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Cross-validate-rather-than-take-a-test-training-split">Cross-validate rather than take a test training split<a class="anchor-link" href="#Cross-validate-rather-than-take-a-test-training-split">&#182;</a></h2><p>Cross-validation rather than taking a test training split reduces the variance of the estimates of goodness of fit statistics. In rare cases one should take a test training split but this should be left to the expert users.</p>
<p>This also means the pro user can just upload the data and not worry about taking a test training split.</p>
<p>We can pass the original, full dataset, <code>df</code> (without passing a <code>leaderboard_frame</code>). This is a more efficient use of our data since we can use 100% of the data for training, rather than 80% or so. This time our leaderboard will use cross-validated metrics. It also gives better estimates of goodness of fit statistics.</p>
<p><em>Note: Using an explicit <code>leaderboard_frame</code> for scoring may be useful in some cases, which is why the option is available.</em></p>
<p>But it's not preferable in most cases. Leave it as an expert option.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[78]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># automl</span>
<span class="c1"># runs for run_time seconds then builds a stacked ensemble</span>
<span class="n">aml</span> <span class="o">=</span> <span class="n">H2OAutoML</span><span class="p">(</span><span class="n">max_runtime_secs</span><span class="o">=</span><span class="n">run_time</span><span class="p">,</span><span class="n">project_name</span> <span class="o">=</span> <span class="n">project</span><span class="p">,</span><span class="n">balance_classes</span><span class="o">=</span><span class="n">balance_y</span><span class="p">)</span> <span class="c1"># init automl, run for 300 seconds</span>
<span class="n">aml</span><span class="o">.</span><span class="n">train</span><span class="p">(</span><span class="n">x</span><span class="o">=</span><span class="n">X</span><span class="p">,</span>
<span class="n">y</span><span class="o">=</span><span class="n">y</span><span class="p">,</span>
<span class="n">training_frame</span><span class="o">=</span><span class="n">df</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>AutoML progress: |████████████████████████████████████████████████████████| 100%
</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Leaderboard">Leaderboard<a class="anchor-link" href="#Leaderboard">&#182;</a></h2><p>Next, we will view the AutoML Leaderboard. Since we did not specify a <code>leaderboard_frame</code> in the <code>H2OAutoML.train()</code> method for scoring and ranking the models, the AutoML leaderboard uses cross-validation metrics to rank the models.</p>
<p>A default performance metric for each machine learning task (binary classification, multiclass classification, regression) is specified internally and the leaderboard will be sorted by that metric. In the case of binary classification, the default ranking metric is Area Under the ROC Curve (AUC). In the future, the user will be able to specify any of the H2O metrics so that different metrics can be used to generate rankings on the leaderboard.</p>
<p>The leader model is stored at <code>aml.leader</code> and the leaderboard is stored at <code>aml.leaderboard</code>.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[79]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># view leaderboard</span>
<span class="n">lb</span> <span class="o">=</span> <span class="n">aml</span><span class="o">.</span><span class="n">leaderboard</span>
<span class="n">lb</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<table>
<thead>
<tr><th>model_id </th><th style="text-align: right;"> auc</th><th style="text-align: right;"> logloss</th><th style="text-align: right;"> mean_per_class_error</th><th style="text-align: right;"> rmse</th><th style="text-align: right;"> mse</th></tr>
</thead>
<tbody>
<tr><td>StackedEnsemble_AllModels_0_AutoML_20181120_154205 </td><td style="text-align: right;">0.70712 </td><td style="text-align: right;"> 0.435531</td><td style="text-align: right;"> 0.349509</td><td style="text-align: right;">0.370103</td><td style="text-align: right;">0.136977</td></tr>
<tr><td>StackedEnsemble_AllModels_0_AutoML_20181120_153506 </td><td style="text-align: right;">0.706222</td><td style="text-align: right;"> 0.435883</td><td style="text-align: right;"> 0.351685</td><td style="text-align: right;">0.370262</td><td style="text-align: right;">0.137094</td></tr>
<tr><td>StackedEnsemble_BestOfFamily_0_AutoML_20181120_153506</td><td style="text-align: right;">0.705212</td><td style="text-align: right;"> 0.43622 </td><td style="text-align: right;"> 0.350829</td><td style="text-align: right;">0.370407</td><td style="text-align: right;">0.137202</td></tr>
<tr><td>GBM_grid_0_AutoML_20181120_154205_model_0 </td><td style="text-align: right;">0.703839</td><td style="text-align: right;"> 0.435055</td><td style="text-align: right;"> 0.353507</td><td style="text-align: right;">0.370225</td><td style="text-align: right;">0.137067</td></tr>
<tr><td>GBM_grid_0_AutoML_20181120_153506_model_0 </td><td style="text-align: right;">0.703216</td><td style="text-align: right;"> 0.435227</td><td style="text-align: right;"> 0.352786</td><td style="text-align: right;">0.370273</td><td style="text-align: right;">0.137102</td></tr>
<tr><td>GBM_grid_0_AutoML_20181120_153506_model_1 </td><td style="text-align: right;">0.702313</td><td style="text-align: right;"> 0.435862</td><td style="text-align: right;"> 0.353887</td><td style="text-align: right;">0.370509</td><td style="text-align: right;">0.137277</td></tr>
<tr><td>GBM_grid_0_AutoML_20181120_154205_model_1 </td><td style="text-align: right;">0.702177</td><td style="text-align: right;"> 0.435943</td><td style="text-align: right;"> 0.354178</td><td style="text-align: right;">0.370554</td><td style="text-align: right;">0.13731 </td></tr>
<tr><td>GBM_grid_0_AutoML_20181120_153506_model_2 </td><td style="text-align: right;">0.70028 </td><td style="text-align: right;"> 0.437029</td><td style="text-align: right;"> 0.354784</td><td style="text-align: right;">0.370872</td><td style="text-align: right;">0.137546</td></tr>
<tr><td>GBM_grid_0_AutoML_20181120_154205_model_2 </td><td style="text-align: right;">0.699971</td><td style="text-align: right;"> 0.43737 </td><td style="text-align: right;"> 0.354552</td><td style="text-align: right;">0.371075</td><td style="text-align: right;">0.137696</td></tr>
<tr><td>DeepLearning_0_AutoML_20181120_154205 </td><td style="text-align: right;">0.699148</td><td style="text-align: right;"> 0.43985 </td><td style="text-align: right;"> 0.355085</td><td style="text-align: right;">0.372547</td><td style="text-align: right;">0.138791</td></tr>
</tbody>
</table>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[79]:</div>
<div class="output_text output_subarea output_execute_result">
<pre></pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>Now we will view a snapshot of the top models. Here we should see the two Stacked Ensembles at or near the top of the leaderboard. Stacked Ensembles can almost always outperform a single model.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[80]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Model Details
=============
H2OStackedEnsembleEstimator : Stacked Ensemble
Model Key: StackedEnsemble_AllModels_0_AutoML_20181120_154205
No model summary for this model
ModelMetricsBinomialGLM: stackedensemble
** Reported on train data. **
MSE: 0.12685990330985406
RMSE: 0.3561739789904002
LogLoss: 0.40703958453227496
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124374.13927893189
Residual deviance: 106607.73758484815
AIC: 106631.73758484815
AUC: 0.7734040182726795
Gini: 0.5468080365453589
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21708051286464972:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>83212.0</td>
<td>23869.0</td>
<td>0.2229</td>
<td> (23869.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9376.0</td>
<td>14498.0</td>
<td>0.3927</td>
<td> (9376.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>92588.0</td>
<td>38367.0</td>
<td>0.2539</td>
<td> (33245.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.2170805</td>
<td>0.4658666</td>
<td>238.0</td></tr>
<tr><td>max f2</td>
<td>0.1410190</td>
<td>0.6067433</td>
<td>309.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3338429</td>
<td>0.4568693</td>
<td>155.0</td></tr>
<tr><td>max accuracy</td>
<td>0.4390853</td>
<td>0.8290100</td>
<td>98.0</td></tr>
<tr><td>max precision</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0676438</td>
<td>1.0</td>
<td>394.0</td></tr>
<tr><td>max specificity</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2335835</td>
<td>0.3269004</td>
<td>224.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1855661</td>
<td>0.6993958</td>
<td>265.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1761337</td>
<td>0.7006208</td>
<td>274.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5809896</td>
<td>4.2290904</td>
<td>4.2290904</td>
<td>0.7709924</td>
<td>0.7709924</td>
<td>0.0423054</td>
<td>0.0423054</td>
<td>322.9090447</td>
<td>322.9090447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5350310</td>
<td>3.4879528</td>
<td>3.8585216</td>
<td>0.6358779</td>
<td>0.7034351</td>
<td>0.0348915</td>
<td>0.0771970</td>
<td>248.7952815</td>
<td>285.8521631</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.5007744</td>
<td>3.1972882</td>
<td>3.6382227</td>
<td>0.5828877</td>
<td>0.6632731</td>
<td>0.0319595</td>
<td>0.1091564</td>
<td>219.7288214</td>
<td>263.8222689</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4718430</td>
<td>2.9436144</td>
<td>3.4645375</td>
<td>0.5366412</td>
<td>0.6316091</td>
<td>0.0294463</td>
<td>0.1386027</td>
<td>194.3614440</td>
<td>246.4537481</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4483865</td>
<td>2.8704357</td>
<td>3.3457716</td>
<td>0.5233002</td>
<td>0.6099572</td>
<td>0.0286923</td>
<td>0.1672950</td>
<td>187.0435684</td>
<td>234.5771560</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3623038</td>
<td>2.4444070</td>
<td>2.8950893</td>
<td>0.4456323</td>
<td>0.5277947</td>
<td>0.1222250</td>
<td>0.2895200</td>
<td>144.4406963</td>
<td>189.5089261</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.3079302</td>
<td>1.9878608</td>
<td>2.5926798</td>
<td>0.3624007</td>
<td>0.4726634</td>
<td>0.0993968</td>
<td>0.3889168</td>
<td>98.7860769</td>
<td>159.2679764</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2684456</td>
<td>1.7116814</td>
<td>2.3724554</td>
<td>0.3120513</td>
<td>0.4325150</td>
<td>0.0855743</td>
<td>0.4744911</td>
<td>71.1681359</td>
<td>137.2455391</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2132009</td>
<td>1.4102670</td>
<td>2.0517178</td>
<td>0.2571014</td>
<td>0.3740423</td>
<td>0.1410321</td>
<td>0.6155232</td>
<td>41.0267006</td>
<td>105.1717765</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1765625</td>
<td>1.1217652</td>
<td>1.8192385</td>
<td>0.2045055</td>
<td>0.3316597</td>
<td>0.1121722</td>
<td>0.7276954</td>
<td>12.1765206</td>
<td>81.9238502</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1503145</td>
<td>0.8745582</td>
<td>1.6302967</td>
<td>0.1594380</td>
<td>0.2972143</td>
<td>0.0874592</td>
<td>0.8151546</td>
<td>-12.5441786</td>
<td>63.0296674</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1300345</td>
<td>0.6769128</td>
<td>1.4714054</td>
<td>0.1234059</td>
<td>0.2682474</td>
<td>0.0676887</td>
<td>0.8828433</td>
<td>-32.3087165</td>
<td>47.1405434</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1129563</td>
<td>0.4959559</td>
<td>1.3320601</td>
<td>0.0904162</td>
<td>0.2428437</td>
<td>0.0495937</td>
<td>0.9324370</td>
<td>-50.4044061</td>
<td>33.2060067</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0978849</td>
<td>0.3920433</td>
<td>1.2145535</td>
<td>0.0714722</td>
<td>0.2214215</td>
<td>0.0392058</td>
<td>0.9716428</td>
<td>-60.7956663</td>
<td>21.4553489</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0824531</td>
<td>0.2194940</td>
<td>1.1039951</td>
<td>0.0400153</td>
<td>0.2012659</td>
<td>0.0219486</td>
<td>0.9935914</td>
<td>-78.0505987</td>
<td>10.3995078</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597755</td>
<td>0.0640840</td>
<td>1.0</td>
<td>0.0116830</td>
<td>0.1823069</td>
<td>0.0064086</td>
<td>1.0</td>
<td>-93.5915993</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on validation data. **
MSE: 0.13813682407268132
RMSE: 0.37166762580655494
LogLoss: 0.4379927029517987
Null degrees of freedom: 33031
Residual degrees of freedom: 33020
Null deviance: 31732.354674481932
Residual deviance: 28935.54992780763
AIC: 28959.54992780763
AUC: 0.7122628231156057
Gini: 0.4245256462312115
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.18933454821029921:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>18652.0</td>
<td>8238.0</td>
<td>0.3064</td>
<td> (8238.0/26890.0)</td></tr>
<tr><td>1</td>
<td>2386.0</td>
<td>3756.0</td>
<td>0.3885</td>
<td> (2386.0/6142.0)</td></tr>
<tr><td>Total</td>
<td>21038.0</td>
<td>11994.0</td>
<td>0.3216</td>
<td> (10624.0/33032.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1893345</td>
<td>0.4142038</td>
<td>256.0</td></tr>
<tr><td>max f2</td>
<td>0.1197407</td>
<td>0.5738535</td>
<td>330.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3129965</td>
<td>0.3817812</td>
<td>160.0</td></tr>
<tr><td>max accuracy</td>
<td>0.6010242</td>
<td>0.8160572</td>
<td>29.0</td></tr>
<tr><td>max precision</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0640080</td>
<td>1.0</td>
<td>398.0</td></tr>
<tr><td>max specificity</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2092723</td>
<td>0.2475688</td>
<td>238.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1762849</td>
<td>0.6525562</td>
<td>268.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1577331</td>
<td>0.6547886</td>
<td>286.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.59 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100206</td>
<td>0.5783690</td>
<td>3.1358434</td>
<td>3.1358434</td>
<td>0.5830816</td>
<td>0.5830816</td>
<td>0.0314230</td>
<td>0.0314230</td>
<td>213.5843447</td>
<td>213.5843447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200109</td>
<td>0.5293169</td>
<td>2.5749465</td>
<td>2.8558192</td>
<td>0.4787879</td>
<td>0.5310136</td>
<td>0.0257245</td>
<td>0.0571475</td>
<td>157.4946469</td>
<td>185.5819237</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300012</td>
<td>0.4955180</td>
<td>2.4119752</td>
<td>2.7080205</td>
<td>0.4484848</td>
<td>0.5035318</td>
<td>0.0240964</td>
<td>0.0812439</td>
<td>141.1975173</td>
<td>170.8020508</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400218</td>
<td>0.4688250</td>
<td>2.4859277</td>
<td>2.6524133</td>
<td>0.4622356</td>
<td>0.4931921</td>
<td>0.0249105</td>
<td>0.1061543</td>
<td>148.5927707</td>
<td>165.2413309</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500121</td>
<td>0.4455599</td>
<td>2.2164096</td>
<td>2.5653181</td>
<td>0.4121212</td>
<td>0.4769976</td>
<td>0.0221426</td>
<td>0.1282970</td>
<td>121.6409619</td>
<td>156.5318141</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000242</td>
<td>0.3612868</td>
<td>2.0607188</td>
<td>2.3130185</td>
<td>0.3831719</td>
<td>0.4300847</td>
<td>0.1030609</td>
<td>0.2313579</td>
<td>106.0718760</td>
<td>131.3018450</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500061</td>
<td>0.3068785</td>
<td>1.7850835</td>
<td>2.1371112</td>
<td>0.3319200</td>
<td>0.3973764</td>
<td>0.0892218</td>
<td>0.3205796</td>
<td>78.5083530</td>
<td>113.7111174</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2000182</td>
<td>0.2675737</td>
<td>1.5756523</td>
<td>1.9967252</td>
<td>0.2929782</td>
<td>0.3712729</td>
<td>0.0788017</td>
<td>0.3993813</td>
<td>57.5652259</td>
<td>99.6725200</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000121</td>
<td>0.2132448</td>
<td>1.3758567</td>
<td>1.7897899</td>
<td>0.2558280</td>
<td>0.3327952</td>
<td>0.1375773</td>
<td>0.5369586</td>
<td>37.5856668</td>
<td>78.9789907</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4000061</td>
<td>0.1764937</td>
<td>1.1299935</td>
<td>1.6248533</td>
<td>0.2101120</td>
<td>0.3021267</td>
<td>0.1129925</td>
<td>0.6499512</td>
<td>12.9993524</td>
<td>62.4853295</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5</td>
<td>0.1497263</td>
<td>0.9964784</td>
<td>1.4991859</td>
<td>0.1852861</td>
<td>0.2787600</td>
<td>0.0996418</td>
<td>0.7495930</td>
<td>-0.3521561</td>
<td>49.9185933</td></tr>
<tr><td></td>
<td>12</td>
<td>0.5999939</td>
<td>0.1296393</td>
<td>0.7587565</td>
<td>1.3757872</td>
<td>0.1410839</td>
<td>0.2558151</td>
<td>0.0758711</td>
<td>0.8254640</td>
<td>-24.1243542</td>
<td>37.5787247</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999879</td>
<td>0.1130667</td>
<td>0.6284978</td>
<td>1.2690362</td>
<td>0.1168635</td>
<td>0.2359657</td>
<td>0.0628460</td>
<td>0.8883100</td>
<td>-37.1502161</td>
<td>26.9036234</td></tr>
<tr><td></td>
<td>14</td>
<td>0.7999818</td>
<td>0.0982229</td>
<td>0.5259192</td>
<td>1.1761501</td>
<td>0.0977899</td>
<td>0.2186944</td>
<td>0.0525887</td>
<td>0.9408987</td>
<td>-47.4080824</td>
<td>17.6150117</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999758</td>
<td>0.0826149</td>
<td>0.3989170</td>
<td>1.0897938</td>
<td>0.0741750</td>
<td>0.2026372</td>
<td>0.0398893</td>
<td>0.9807880</td>
<td>-60.1082978</td>
<td>8.9793790</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0605773</td>
<td>0.1920733</td>
<td>1.0</td>
<td>0.0357143</td>
<td>0.1859409</td>
<td>0.0192120</td>
<td>1.0</td>
<td>-80.7926687</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on cross-validation data. **
MSE: 0.1369765435568584
RMSE: 0.3701034227845757
LogLoss: 0.4355309009590542
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124375.46514588114
Residual deviance: 114069.89827018589
AIC: 114093.89827018589
AUC: 0.7071203432205223
Gini: 0.4142406864410446
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.17843972441369682:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>73561.0</td>
<td>33520.0</td>
<td>0.313</td>
<td> (33520.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9215.0</td>
<td>14659.0</td>
<td>0.386</td>
<td> (9215.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>82776.0</td>
<td>48179.0</td>
<td>0.3263</td>
<td> (42735.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1784397</td>
<td>0.4068949</td>
<td>261.0</td></tr>
<tr><td>max f2</td>
<td>0.1136746</td>
<td>0.5665672</td>
<td>334.0</td></tr>
<tr><td>max f0point5</td>
<td>0.2879939</td>
<td>0.3708050</td>
<td>176.0</td></tr>
<tr><td>max accuracy</td>
<td>0.5663591</td>
<td>0.8184567</td>
<td>36.0</td></tr>
<tr><td>max precision</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0620870</td>
<td>1.0</td>
<td>399.0</td></tr>
<tr><td>max specificity</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.1815977</td>
<td>0.2412252</td>
<td>258.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1671726</td>
<td>0.6498819</td>
<td>272.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1616542</td>
<td>0.6512829</td>
<td>278.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5609815</td>
<td>2.9394272</td>
<td>2.9394272</td>
<td>0.5358779</td>
<td>0.5358779</td>
<td>0.0294044</td>
<td>0.0294044</td>
<td>193.9427222</td>
<td>193.9427222</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5136764</td>
<td>2.6044498</td>
<td>2.7719385</td>
<td>0.4748092</td>
<td>0.5053435</td>
<td>0.0260534</td>
<td>0.0554578</td>
<td>160.4449761</td>
<td>177.1938491</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.4802174</td>
<td>2.4346323</td>
<td>2.6595603</td>
<td>0.4438503</td>
<td>0.4848562</td>
<td>0.0243361</td>
<td>0.0797939</td>
<td>143.4632310</td>
<td>165.9560331</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4541967</td>
<td>2.2987828</td>
<td>2.5693487</td>
<td>0.4190840</td>
<td>0.4684100</td>
<td>0.0229957</td>
<td>0.1027896</td>
<td>129.8782827</td>
<td>156.9348739</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4304407</td>
<td>2.3592048</td>
<td>2.5273392</td>
<td>0.4300993</td>
<td>0.4607514</td>
<td>0.0235821</td>
<td>0.1263718</td>
<td>135.9204803</td>
<td>152.7339208</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3489922</td>
<td>2.0674422</td>
<td>2.2973907</td>
<td>0.3769090</td>
<td>0.4188302</td>
<td>0.1033761</td>
<td>0.2297478</td>
<td>106.7442216</td>
<td>129.7390712</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.2957391</td>
<td>1.7583311</td>
<td>2.1177042</td>
<td>0.3205559</td>
<td>0.3860721</td>
<td>0.0879199</td>
<td>0.3176678</td>
<td>75.8331123</td>
<td>111.7704182</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2569097</td>
<td>1.5826559</td>
<td>1.9839574</td>
<td>0.2885291</td>
<td>0.3616891</td>
<td>0.0791237</td>
<td>0.3967915</td>
<td>58.2655941</td>
<td>98.3957443</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2032167</td>
<td>1.3679632</td>
<td>1.7786208</td>
<td>0.2493891</td>
<td>0.3242548</td>
<td>0.1368015</td>
<td>0.5335930</td>
<td>36.7963184</td>
<td>77.8620797</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1679941</td>
<td>1.1284673</td>
<td>1.6160886</td>
<td>0.2057274</td>
<td>0.2946241</td>
<td>0.1128424</td>
<td>0.6464355</td>
<td>12.8467313</td>
<td>61.6088632</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1428590</td>
<td>0.9302652</td>
<td>1.4789198</td>
<td>0.1695938</td>
<td>0.2696173</td>
<td>0.0930301</td>
<td>0.7394655</td>
<td>-6.9734773</td>
<td>47.8919761</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1238863</td>
<td>0.8143060</td>
<td>1.3681550</td>
<td>0.1484536</td>
<td>0.2494241</td>
<td>0.0814275</td>
<td>0.8208930</td>
<td>-18.5693965</td>
<td>36.8155036</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1081113</td>
<td>0.6589009</td>
<td>1.2668363</td>
<td>0.1201222</td>
<td>0.2309530</td>
<td>0.0658876</td>
<td>0.8867806</td>
<td>-34.1099078</td>
<td>26.6836336</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0941428</td>
<td>0.5185360</td>
<td>1.1732952</td>
<td>0.0945327</td>
<td>0.2138998</td>
<td>0.0518556</td>
<td>0.9386362</td>
<td>-48.1464047</td>
<td>17.3295217</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0801775</td>
<td>0.3945866</td>
<td>1.0867750</td>
<td>0.0719359</td>
<td>0.1981266</td>
<td>0.0394572</td>
<td>0.9780933</td>
<td>-60.5413434</td>
<td>8.6774970</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597666</td>
<td>0.2190584</td>
<td>1.0</td>
<td>0.0399359</td>
<td>0.1823069</td>
<td>0.0219067</td>
<td>1.0</td>
<td>-78.0941597</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[80]:</div>
<div class="output_text output_subarea output_execute_result">
<pre></pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[81]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">algo</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[81]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&#39;stackedensemble&#39;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[82]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="nb">dir</span><span class="p">(</span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[82]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>[&#39;F0point5&#39;,
&#39;F1&#39;,
&#39;F2&#39;,
&#39;__class__&#39;,
&#39;__delattr__&#39;,
&#39;__dict__&#39;,
&#39;__dir__&#39;,
&#39;__doc__&#39;,
&#39;__eq__&#39;,
&#39;__format__&#39;,
&#39;__ge__&#39;,
&#39;__getattr__&#39;,
&#39;__getattribute__&#39;,
&#39;__gt__&#39;,
&#39;__hash__&#39;,
&#39;__init__&#39;,
&#39;__init_subclass__&#39;,
&#39;__le__&#39;,
&#39;__lt__&#39;,
&#39;__module__&#39;,
&#39;__ne__&#39;,
&#39;__new__&#39;,
&#39;__reduce__&#39;,
&#39;__reduce_ex__&#39;,
&#39;__repr__&#39;,
&#39;__setattr__&#39;,
&#39;__sizeof__&#39;,
&#39;__str__&#39;,
&#39;__subclasshook__&#39;,
&#39;__weakref__&#39;,
&#39;_bc&#39;,
&#39;_bcin&#39;,
&#39;_check_targets&#39;,
&#39;_compute_algo&#39;,
&#39;_estimator_type&#39;,
&#39;_future&#39;,
&#39;_get_metrics&#39;,
&#39;_have_mojo&#39;,
&#39;_have_pojo&#39;,
&#39;_id&#39;,
&#39;_is_xvalidated&#39;,
&#39;_job&#39;,
&#39;_keyify_if_h2oframe&#39;,
&#39;_metrics_class&#39;,
&#39;_model_json&#39;,
&#39;_parms&#39;,
&#39;_plot&#39;,
&#39;_requires_training_frame&#39;,
&#39;_resolve_model&#39;,
&#39;_verify_training_frame_params&#39;,
&#39;_xval_keys&#39;,
&#39;accuracy&#39;,
&#39;actual_params&#39;,
&#39;aic&#39;,
&#39;algo&#39;,
&#39;auc&#39;,
&#39;base_models&#39;,
&#39;biases&#39;,
&#39;catoffsets&#39;,
&#39;coef&#39;,
&#39;coef_norm&#39;,
&#39;confusion_matrix&#39;,
&#39;cross_validation_fold_assignment&#39;,
&#39;cross_validation_holdout_predictions&#39;,
&#39;cross_validation_metrics_summary&#39;,
&#39;cross_validation_models&#39;,
&#39;cross_validation_predictions&#39;,
&#39;deepfeatures&#39;,
&#39;default_params&#39;,
&#39;download_mojo&#39;,
&#39;download_pojo&#39;,
&#39;error&#39;,
&#39;fallout&#39;,
&#39;find_idx_by_threshold&#39;,
&#39;find_threshold_by_max_metric&#39;,
&#39;fit&#39;,
&#39;fnr&#39;,
&#39;fpr&#39;,
&#39;full_parameters&#39;,
&#39;gains_lift&#39;,
&#39;get_params&#39;,
&#39;get_xval_models&#39;,
&#39;gini&#39;,
&#39;have_mojo&#39;,
&#39;have_pojo&#39;,
&#39;is_cross_validated&#39;,
&#39;join&#39;,
&#39;keep_levelone_frame&#39;,
&#39;levelone_frame_id&#39;,
&#39;logloss&#39;,
&#39;mae&#39;,
&#39;max_per_class_error&#39;,
&#39;mcc&#39;,
&#39;mean_per_class_error&#39;,
&#39;mean_residual_deviance&#39;,
&#39;metalearner&#39;,
&#39;metalearner_algorithm&#39;,
&#39;metalearner_fold_assignment&#39;,
&#39;metalearner_fold_column&#39;,
&#39;metalearner_nfolds&#39;,
&#39;metalearner_params&#39;,
&#39;metric&#39;,
&#39;missrate&#39;,
&#39;mixin&#39;,
&#39;model_id&#39;,
&#39;model_performance&#39;,
&#39;mse&#39;,
&#39;normmul&#39;,
&#39;normsub&#39;,
&#39;null_degrees_of_freedom&#39;,
&#39;null_deviance&#39;,
&#39;params&#39;,
&#39;parms&#39;,
&#39;partial_plot&#39;,
&#39;plot&#39;,
&#39;pprint_coef&#39;,
&#39;precision&#39;,
&#39;predict&#39;,
&#39;predict_leaf_node_assignment&#39;,
&#39;r2&#39;,
&#39;recall&#39;,
&#39;residual_degrees_of_freedom&#39;,
&#39;residual_deviance&#39;,
&#39;respmul&#39;,
&#39;response_column&#39;,
&#39;respsub&#39;,
&#39;rmse&#39;,
&#39;rmsle&#39;,
&#39;roc&#39;,
&#39;rotation&#39;,
&#39;save_model_details&#39;,
&#39;save_mojo&#39;,
&#39;score_history&#39;,
&#39;scoring_history&#39;,
&#39;seed&#39;,
&#39;sensitivity&#39;,
&#39;set_params&#39;,
&#39;show&#39;,
&#39;specificity&#39;,
&#39;start&#39;,
&#39;std_coef_plot&#39;,
&#39;summary&#39;,
&#39;tnr&#39;,
&#39;tpr&#39;,
&#39;train&#39;,
&#39;training_frame&#39;,
&#39;type&#39;,
&#39;validation_frame&#39;,
&#39;varimp&#39;,
&#39;varimp_plot&#39;,
&#39;weights&#39;,
&#39;xval_keys&#39;,
&#39;xvals&#39;]</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Ensemble-Exploration">Ensemble Exploration<a class="anchor-link" href="#Ensemble-Exploration">&#182;</a></h2><p>To understand how the ensemble works, let's take a peek inside the Stacked Ensemble "All Models" model. The "All Models" ensemble is an ensemble of all of the individual models in the AutoML run. This is often the top performing model on the leaderboard.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[83]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml_leaderboard_df</span><span class="o">=</span><span class="n">aml</span><span class="o">.</span><span class="n">leaderboard</span><span class="o">.</span><span class="n">as_data_frame</span><span class="p">()</span>
<span class="n">aml_leaderboard_df</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[83]:</div>
<div class="output_html rendered_html output_subarea output_execute_result">
<div>
<style>
.dataframe thead tr:only-child th {
text-align: right;
}
.dataframe thead th {
text-align: left;
}
.dataframe tbody tr th {
vertical-align: top;
}
</style>
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>model_id</th>
<th>auc</th>
<th>logloss</th>
<th>mean_per_class_error</th>
<th>rmse</th>
<th>mse</th>
</tr>
</thead>
<tbody>
<tr>
<th>0</th>
<td>StackedEnsemble_AllModels_0_AutoML_20181120_15...</td>
<td>0.707120</td>
<td>0.435531</td>
<td>0.349509</td>
<td>0.370103</td>
<td>0.136977</td>
</tr>
<tr>
<th>1</th>
<td>StackedEnsemble_AllModels_0_AutoML_20181120_15...</td>
<td>0.706222</td>
<td>0.435883</td>
<td>0.351685</td>
<td>0.370262</td>
<td>0.137094</td>
</tr>
<tr>
<th>2</th>
<td>StackedEnsemble_BestOfFamily_0_AutoML_20181120...</td>
<td>0.705212</td>
<td>0.436220</td>
<td>0.350829</td>
<td>0.370407</td>
<td>0.137202</td>
</tr>
<tr>
<th>3</th>
<td>GBM_grid_0_AutoML_20181120_154205_model_0</td>
<td>0.703839</td>
<td>0.435055</td>
<td>0.353507</td>
<td>0.370225</td>
<td>0.137067</td>
</tr>
<tr>
<th>4</th>
<td>GBM_grid_0_AutoML_20181120_153506_model_0</td>
<td>0.703216</td>
<td>0.435227</td>
<td>0.352786</td>
<td>0.370273</td>
<td>0.137102</td>
</tr>
<tr>
<th>5</th>
<td>GBM_grid_0_AutoML_20181120_153506_model_1</td>
<td>0.702313</td>
<td>0.435862</td>
<td>0.353887</td>
<td>0.370509</td>
<td>0.137277</td>
</tr>
<tr>
<th>6</th>
<td>GBM_grid_0_AutoML_20181120_154205_model_1</td>
<td>0.702177</td>
<td>0.435943</td>
<td>0.354178</td>
<td>0.370554</td>
<td>0.137310</td>
</tr>
<tr>
<th>7</th>
<td>GBM_grid_0_AutoML_20181120_153506_model_2</td>
<td>0.700280</td>
<td>0.437029</td>
<td>0.354784</td>
<td>0.370872</td>
<td>0.137546</td>
</tr>
<tr>
<th>8</th>
<td>GBM_grid_0_AutoML_20181120_154205_model_2</td>
<td>0.699971</td>
<td>0.437370</td>
<td>0.354552</td>
<td>0.371075</td>
<td>0.137696</td>
</tr>
<tr>
<th>9</th>
<td>DeepLearning_0_AutoML_20181120_154205</td>
<td>0.699148</td>
<td>0.439850</td>
<td>0.355085</td>
<td>0.372547</td>
<td>0.138791</td>
</tr>
<tr>
<th>10</th>
<td>GLM_grid_0_AutoML_20181120_154205_model_0</td>
<td>0.697503</td>
<td>0.438455</td>
<td>0.354668</td>
<td>0.371441</td>
<td>0.137968</td>
</tr>
<tr>
<th>11</th>
<td>GLM_grid_0_AutoML_20181120_153506_model_0</td>
<td>0.697503</td>
<td>0.438455</td>
<td>0.354668</td>
<td>0.371441</td>
<td>0.137968</td>
</tr>
<tr>
<th>12</th>
<td>DeepLearning_0_AutoML_20181120_153506</td>
<td>0.696297</td>
<td>0.439618</td>
<td>0.357903</td>
<td>0.371964</td>
<td>0.138357</td>
</tr>
<tr>
<th>13</th>
<td>GBM_grid_0_AutoML_20181120_154205_model_4</td>
<td>0.694225</td>
<td>0.443191</td>
<td>0.361761</td>
<td>0.372926</td>
<td>0.139073</td>
</tr>
<tr>
<th>14</th>
<td>GBM_grid_0_AutoML_20181120_153506_model_4</td>
<td>0.694205</td>
<td>0.442884</td>
<td>0.358243</td>
<td>0.372862</td>
<td>0.139026</td>
</tr>
<tr>
<th>15</th>
<td>GBM_grid_0_AutoML_20181120_153506_model_3</td>
<td>0.690842</td>
<td>0.443542</td>
<td>0.362873</td>
<td>0.373139</td>
<td>0.139233</td>
</tr>
<tr>
<th>16</th>
<td>GBM_grid_0_AutoML_20181120_154205_model_3</td>
<td>0.689891</td>
<td>0.443962</td>
<td>0.363898</td>
<td>0.373311</td>
<td>0.139361</td>
</tr>
<tr>
<th>17</th>
<td>XRT_0_AutoML_20181120_154205</td>
<td>0.688110</td>
<td>0.471744</td>
<td>0.364619</td>
<td>0.382286</td>
<td>0.146143</td>
</tr>
<tr>
<th>18</th>
<td>XRT_0_AutoML_20181120_153506</td>
<td>0.687225</td>
<td>0.472021</td>
<td>0.365550</td>
<td>0.382442</td>
<td>0.146262</td>
</tr>
<tr>
<th>19</th>
<td>DRF_0_AutoML_20181120_154205</td>
<td>0.684609</td>
<td>0.479048</td>
<td>0.366846</td>
<td>0.383622</td>
<td>0.147166</td>
</tr>
<tr>
<th>20</th>
<td>DRF_0_AutoML_20181120_153506</td>
<td>0.684478</td>
<td>0.479350</td>
<td>0.367447</td>
<td>0.383614</td>
<td>0.147160</td>
</tr>
<tr>
<th>21</th>
<td>DRF_0_AutoML_20181120_153207</td>
<td>0.683488</td>
<td>0.479453</td>
<td>0.368185</td>
<td>0.383608</td>
<td>0.147155</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Getting-models">Getting models<a class="anchor-link" href="#Getting-models">&#182;</a></h2><p>Individul models can ne found through a search of the leader board or directly by the name.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[84]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># Get model ids for all models in the AutoML Leaderboard</span>
<span class="n">model_ids</span> <span class="o">=</span> <span class="nb">list</span><span class="p">(</span><span class="n">aml</span><span class="o">.</span><span class="n">leaderboard</span><span class="p">[</span><span class="s1">&#39;model_id&#39;</span><span class="p">]</span><span class="o">.</span><span class="n">as_data_frame</span><span class="p">()</span><span class="o">.</span><span class="n">iloc</span><span class="p">[:,</span><span class="mi">0</span><span class="p">])</span>
<span class="c1"># Get the &quot;All Models&quot; Stacked Ensemble model</span>
<span class="n">se</span> <span class="o">=</span> <span class="n">h2o</span><span class="o">.</span><span class="n">get_model</span><span class="p">([</span><span class="n">mid</span> <span class="k">for</span> <span class="n">mid</span> <span class="ow">in</span> <span class="n">model_ids</span> <span class="k">if</span> <span class="s2">&quot;StackedEnsemble_AllModels&quot;</span> <span class="ow">in</span> <span class="n">mid</span><span class="p">][</span><span class="mi">0</span><span class="p">])</span>
<span class="c1"># Get the Stacked Ensemble metalearner model</span>
<span class="n">metalearner</span> <span class="o">=</span> <span class="n">h2o</span><span class="o">.</span><span class="n">get_model</span><span class="p">(</span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">metalearner</span><span class="p">()[</span><span class="s1">&#39;name&#39;</span><span class="p">])</span>
</pre></div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[85]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">metalearner</span><span class="o">.</span><span class="n">coef_norm</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[85]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>{&#39;DRF_0_AutoML_20181120_153207&#39;: 0.0,
&#39;DRF_0_AutoML_20181120_153506&#39;: 0.0,
&#39;DRF_0_AutoML_20181120_154205&#39;: 0.0,
&#39;DeepLearning_0_AutoML_20181120_153506&#39;: 0.1344838464922838,
&#39;DeepLearning_0_AutoML_20181120_154205&#39;: 0.16114849497175607,
&#39;GBM_grid_0_AutoML_20181120_153506_model_0&#39;: 0.06857343556357838,
&#39;GBM_grid_0_AutoML_20181120_153506_model_1&#39;: 0.06556630998879215,
&#39;GBM_grid_0_AutoML_20181120_153506_model_2&#39;: 0.06399896524231677,
&#39;GBM_grid_0_AutoML_20181120_153506_model_3&#39;: 0.0,
&#39;GBM_grid_0_AutoML_20181120_153506_model_4&#39;: 0.029475852258499607,
&#39;GBM_grid_0_AutoML_20181120_154205_model_0&#39;: 0.10436142902876248,
&#39;GBM_grid_0_AutoML_20181120_154205_model_1&#39;: 0.030089245243887962,
&#39;GBM_grid_0_AutoML_20181120_154205_model_2&#39;: 0.024832084306272362,
&#39;GBM_grid_0_AutoML_20181120_154205_model_3&#39;: 0.0,
&#39;GBM_grid_0_AutoML_20181120_154205_model_4&#39;: 0.03820562737398706,
&#39;GLM_grid_0_AutoML_20181120_153506_model_0&#39;: 0.0,
&#39;GLM_grid_0_AutoML_20181120_154205_model_0&#39;: 0.0,
&#39;Intercept&#39;: -1.648080783111384,
&#39;XRT_0_AutoML_20181120_153506&#39;: 0.0,
&#39;XRT_0_AutoML_20181120_154205&#39;: 0.006042541276377857}</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[86]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="o">%</span><span class="k">matplotlib</span> inline
<span class="n">metalearner</span><span class="o">.</span><span class="n">std_coef_plot</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stderr output_text">
<pre>/Users/bear/anaconda/lib/python3.6/site-packages/matplotlib/cbook/deprecation.py:107: MatplotlibDeprecationWarning: Passing one of &#39;on&#39;, &#39;true&#39;, &#39;off&#39;, &#39;false&#39; as a boolean is deprecated; use an actual boolean (True/False) instead.
warnings.warn(message, mplDeprecation, stacklevel=1)
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_png output_subarea ">
<img src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAABB0AAAJTCAYAAABEh264AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz
AAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBo
dHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzs3Xm8XdP9//HXmxgbVFHVBKEoWgRp
qEZLqamtodVWaooaaiqd6UgHX9SvVWqu1tQh5pqHUmqMoUTSGNpIg6ClaMwifH5/rM9xd84959xz
k3vcK97Px+M87j1rr7X2Z++zz03W2mutrYjAzMzMzMzMzKyvzdPfAZiZmZmZmZnZ3MmdDmZmZmZm
ZmbWEe50MDMzMzMzM7OOcKeDmZmZmZmZmXWEOx3MzMzMzMzMrCPc6WBmZmZmZmZmHeFOBzMzs7cY
ScMkhaTT+zmO0zOOYZW0ARFbjaRDM56N+juWviBptKS7JT2Xx/XL/o5poJE0KM/NNf0cx+8yjqH9
GYeZWX9zp4OZmc31JM0raU9Jf5X0tKRXJT0haYKkUyVtXZd/TDYWxvRTyNbPJM0vaXdJl0l6XNIr
2dAfL+mXktbsh5g+DPweWAQ4EfgRcOVs1rVSXuMh6VlJ72iSbx5JUyt5R832AfQzST99qx9DX6tc
B5Nb5Kl14sysS18y/67+SdJkSS9J+p+kGyXtJkkt6pSkz0m6uPL9+m+W/aqkhebgmD4k6WRJkyRN
z7/3T2bdP5K0coMytQ6indqov3YdhaTftMi3SSVf0/Nr9nYwqL8DMDMz6yRJ8wKXAlsA/wMuA6YB
7wLeB3wRWBW4uL9inMs8CqwGTO/vQGaXpFWAP1GO47/An4GHgfmB1YG9gQMkbRsRb+Z180lAwC4R
cUsf1TmT0onxBeC3DbZvBiyf+d4S/2+MiJmSVgNe6O9Y5nI7AL8CHgOuAx4B3gN8hnItbUG5rmYh
aXHgXGATuv4mP0z5m7wFcDTwFUmfioj72g1G0gIZz57A68AtwF+AZ4HFgXWB7wPfl/TpiLi894c8
i5nAFyR9NSKea7B9T95C3xuzTvKXwMzM5najKf+RvQf4WETM0hiWtDCwXn8ENjeKiFeB+/s7jtkl
aWngWmAo8EvguxHxUl2edwOHUBoyb6b35s/H+rDO24GVKA2kRp0OewIvATcAm/fhfjsqIt6y1+Bb
yP3Ap4ArIuL1WqKk71Guq89L+kNEXFTZNi9wPrAxcDmwU0Q8U9k+H/BT4NvA1ZLWiYgn24znVGAn
yt/60Y06LHIq2PeAd/biOJu5FNiW0nF9ct1+lgS2Ay7Jn2Zva55eYWZmc7sN8ufp9R0OABHxYkRc
V3sv6XrgtHx7WmV47BtrF0h6r6QfSrpZ0r8lzZD0mKQ/5B3WWaiyzkH+PjaHEr8s6U5Jn2oUuKRF
JP1C0rTMe7+kr9Pk329Jq0g6Iut8MocsPyTpFDWYVy5po4zrUEkjVaYSPK3u6zRsmkOTX8jtf5K0
apMYuq3poK7pKq1ew+rqWU/SeZXz+0gOmX4vDUhaV9KVKlMgnpV0jcp0hN76KaXD4Y8R8bX6DgeA
iHgiIvYDxtbFsIyk41WmI8zIz+ACSes225nKGg3XSXomP+P7JH0/79rW8oyRFMBumfSvZudtNrwK
nAGsL+mDdbEtDXyaclf6f03i30RlitJ9ed5flPR3ST+oHkNdmfdKOiPPz0sqa1TslNdZSPp+Xf6b
JM2UNF+em8l5bT8s6fBsqFbzd1vTQdI0SmMT4MbK+ZtZv58mMe+hJsPvJW2u8reg9v24UGW0TFOS
Pizp/Lrr+yRJyzTI+748xw/m+XpK0kRJJ6qMGugXEXFNRFxW7XDI9MeAU/LtRnXFdqZ0OPwT2L7a
4ZBlX42Ig4DzKN/DH7cTi6RNKB0OTwKbNRshERFTI2JP4Jx26u3BZcDjlI65ertQRkb9ug/2Y/aW
55EOZmY2t3sqf7ZsBFScTmlgbQNcBIyvbKs1vD4KHEwZUnw+8DywMrA9sLWkj0TEPQ3qXp5yB3AK
cBZlOPEXgIskbVrX+bEA5Y77hyh37n5PuTv3A+BjTWL/DGXo/3WUocUzgA8AewCfljQiIh5tUO7D
wHeAmyh3u5fMskjaHjg7359N+U/2KOBWYEKTOOqNp6w/UG8x4EAggJdriZJ2o/xn/RXKtJdHKOe3
dhzrR8TDlfwbANdQ/pN/ATAZGA5cTxle3RaVeeQ759tG8c4iIl6plF2Bcv7em/v8I7As8Dngk5I+
GxGX1u3vN8CXKNN9LqBcX+sDPwE2kfSJiJhJ1/nbFlgLOIaua7FhZ0AvnQp8i3J+v1pJHwPMR/ks
9m9S9jvAisA4yl3dhYGPUBqLH5O0eUS8Vsss6T2Ua2c5yuczDliG0ki9qoc4x1Ku1SuB5yjTTQ6m
XK+NGn5Vv6Ccvw0pnYq16+f1piXaIOkLwB8o1+rZwL8pfx9uBe5tUmZP4CTKCJKLKZ//KnkMn5K0
Xu17KmkIcAcwmDIy4DxgIWAFSsP2GKA6UmAaMARYNiKmzcmxzaFX82d9J07tczqqUYdexU8of093
lXRgRMzoYX975M8TI+KJnoLL79Wcmkm5lr4raXhEVP+t2IPyd+j6PtiP2VtfRPjll19++eXXXPsC
1qY0mF+nNPQ/AyzfQ5kxlIbwmCbb3w0s0iB9LUoHxBV16cOyvgAOqdu2eaZfXpf+3Uw/H5inkr4C
8HRuO72uzBBggQZxbQa8RvkPeTV9o0pcX25QbjCl0+ZVYETdtqMrZYc1ONbT6+urKz8fpaMggAMr
6avk5zUZGFJX5uN5HBdW0kQZ5h3ANnX5D6zEuFEb18qGmXfabFxnV2XZ79Wlb0BpnDwFDG5wjV0A
LFRX5tD685Lpp9ef7zn4XqyUdV2f76/PGBeonNd/Avfl+7GZf1RdPSsCalD/4Zn/s3XpZ2T6YXXp
6+TnHsD367bdlOm3A4vXXZ9T8vwuVUkflPmvqavnp42OoW4/M5ts2yPL7lRJW5TS4J8BrF2X/1eV
a29oJX21zP8AsEyT7+m5lbSvZR37Nfl+LliXNq1+n21eB0/nddfo9ePM0/DcNKhzPkqHSwCbVNLn
p/wtCWCFNur5T+Zdv428D2fej83m9+F39Z9vi7y162gM5e/x68Dxle2jcvtBwIL5++TZicsvv+aW
l6dXmJnZXC0i7qYMu/1P/jwfmJpDlC+U9OnZqPOJaLBwWJTRDX8BNq4f8p0eovyHtVrmKsp/mEfW
5d2N8p/Zb0dl+HJE/As4tklcj0bl7nsl/WpgEs3n5I+PiJMbpG9DGY3xh4i4s27boczZYpEnURaS
+1VEHFNJ34fSaDkw6kZlRMRfKHeGPy1pkUzeAHg/cENU5o6n44AHexFTbWh7r+4Qq0xd2YzyOf6s
LuZbKKMe3kXp8Ko5kNJY/lJ0v+P7E0oHwI69iWMO/ZoS42fz/UaUBmnL4eERMSUiosGmo/PnG9ec
pAUpI3ueAf6vrp67KKN5Wvl2VIbjR8TzlHM7L2WRwDfbdpTRR2fl35mqH1JGY9Tbl3J9HxARj1c3
5Pf0cmBbdX+aSKNpPs9HxMt1yR+jdGz8u+2jKBanrFPS6PWDXtZ1VMZwcURcW0lfkq5R1o+0UU8t
T8MpVXXekz+7jeSStI7KFLLqa5c26uxR/j2+FthRZX0g6FpA8vS+2IfZ3MDTK8zMbK4XEedIupAy
l3gUZfTDKMpw620lnUkZ1dCo8dSQpE9SpjKMYNb/TNcsSZmKUDU+KkPNKx6hDBuv1b0IpcH3SEQ0
ajRfT2kM1MckSkN1DGXUxeKUBllNsyHKtzdJXyd//rV+Q0RMlzSe5lM9mlJZaO5LlOH4X63bXDsP
H5P0oQbF3005plWAv/UQ42uSbqI8paSt0GpF28xfs3b+vDHKQpr1/kLp8FobODMbJ2tRnozxVTV+
suArlIbbm+V8SmfWnpTpAntRrpczWxWSNJjyGW5L+UwG03UeoYy+qVkNWAC4JSIaPVniJsq120x9
xxd0NUz7Y22DVtfeM5ImUKaaVNWu743VeM2R2t+SlSjTqi6idEKdJGkryoiamykjULpdp03+XrTj
wYhYqdEGSYPomi7RksqaMwdSOjnH1G/uZUyz831slHcduv+9vJYeru1e+DWwKfA5SRdRplRdHBH/
yY42s7c9dzqYmdnbQjYGr85XbRX1z1LWMNgFuJDymMQeSTqArrnUtccpvkj5D29t3n2jRfSazb+f
yayLQy6WP//TJH+zu5i/oDQAH6c0Th6l6w7pGMqaEr2pb3bjaErSaEoj6m+UFebr59QvkT+/1UNV
gzsQY+2pEN0W3exBLYb6Tibq0msr5i9OaVAtRYPOo/4QES9L+h3lUYXrU+7iXxgR/21WRtL8lA6w
dYGJlCkYT1IaqPNQ7pBXvwc9fVbN0gFey5EN9Wpz8+dtsK3TZufaq13fB/VQ92AoI0kkrUe5Tjan
ayTKw5KOiojjehFvR0k6EPg58HfKtIpn6rI8SdcjJJcF/tVDlbXvYbPvVdW/s84h1I1uiohTKeuW
oLIAbtuP4WzTnyjHtgfl8bML4QUkzWbhTgczM3tbyhEH50hag/Ls9o/TRqdD3vX7EeU/uevUD5Fu
cveyt2rTFpZusv099Qkqj3E8gPIf/g3qp39kY7+ZZncSex1HK5Jqi/g9Any6yd3u2j4Xi4hn26i2
L2O8kzLCYKik90fEA22Wq8XQbF/L1OWr/bw7ItZpkL+/nEK5hs6ldBac0jo7n6F0OPwmIvaobpC0
LN2H5dc+z2afVbP0N8vrlAFD8zToDGv0iMXZufZqZd4RES+2E1RETKI8fnIQpUNzM+ArwK8kPRcR
Z7RTTydJ+iZlWsU9wKaNOqsiYoakOyijPTalRcM8/y6/m9JpWj91pZGbgR0oU7Zu6PUBzIE8rjOA
b1LWeHiI7Nw2s8JrOpiZ2dtdrXFeHfpbmwLR6O7pkpQGyC0NOhwG0zXkerZlh8FkYIikRlMDNmqQ
tiLl3/WrG3Q4DM3tvXVX/uw2hULSYpQnRLRF0sqU0SSvAJ+sP3cV4/Lnhn0Q47yUaTRtybUVzsq3
Pc5jV9cjIWuNolHZMKy3cTXWvGM/CfiApHe1G1+nZeP2Vsod5gcpT0FppTYc//wG2xpNu7mX8vkP
b7BmAfTis5pNrb7XUEYuzcOsU0JqRjRIa3XtLQ6s2aBMb6/vN0TEzIj4W0QcTtd6H9v2tp6+ltOl
jqKcj4+3Gh1DjjgAvtHD1IPaY1PPaLROTYt695a0VBv5+1pt/0MonXBz9FQUs7mNOx3MzGyuJmm0
pE9I6vZvXj6+r/YIt+rdsdpjNpdrUOUTlKkU62YnQ62u+ShTLpbsk8DLiIB5gCOrseejGQ9okH9q
/hyVje1a/sGUO4qzM7rxIkpD7IuS6htdh9I1vLwlSUtSFshbDNg+Iv7eIvtxlOH5R0vq9phTSfPn
iImaWyhPAviopG3qsu9P++s51HyfspDkjpKOysdo1sewpKRjKXdWifJowj9Tntzx1bq86wFfpJzH
CyubfkFZzf+3krrdRZe0uKS2O7AkLSNpVUmLtlumid0pUyu2b2ONk6n5c6O6WN5HeXrFLHLRw3Mp
00u+W1dmbTq/cGar7zV0rW0yy+M3JW1Gmadf70LKyIWdM/6qH1OG2tf7FWWKwTGSuq2hkNf3qMr7
kTmKqV5tdMUsoyUkvS+vgzdlNLOkQymL495OmVLxdA9FzqT8rX0/ZaTZLNe+pEGS/g/4PGV6WFvT
j3LByt9RRkdcldMoGmk0YmWO5aioLSjfneM7sQ+ztzJPrzAzs7ndepSFzf6diwrW5hGvAHySMv/2
IuC8SplbKf+Z/2reia7N2f5VLqB4LHAwMDEXDpufcjf7XZS7wxsz535OuYv5WeAuSVdRGu1foPyn
fetq5oj4t6SxlIbweElXZ/5PAC8D4+nFyISs83lJewFnAzdKOpsyv3oU8MGM46NtVPVjyl3xu4CP
SKpfXA/glxHxv4i4X9KXKGttTJJ0JfAPyor/y1HuED8JrJoxhqTdKY3+8yVdQBklshZlCPeVlMZA
u8f8H0mbUKbafBPYVVJt3Y75KYshbkSZflC9y7w3ZYj3UdlIvZMyx/xzlGH7u1VHoETEbyWtS3ma
wYP5+T5MuYZWoJzX07LedhxFabTvTGl8zZaIuI/257xfRPk+fVvSWpSh9csDnwIupVyr9b5NOX/f
lbQB5bu2TOa9jHJOO3WX+C+UqURHZrz/A16PiNqTNH4DfAP4QXYi3Ee5zragdDB8tlpZRDwraW/K
wps35/fj35TPbjXKwpij6spMkrQHpSPwXklXUB5NugBd1/djlO8XlPVm9pL0V8p1/T/Kd+nTlO91
9ckvUBa1HEK59nr1FJbeyu/dIZQRJDfTeFHUKRHxxoKNETFT0mcoo2M+DUyRdBld1/4WlM67KZQp
WE/0IqQ9KCNpdqf87biZ8nfvuax7Fcq193rG28hekjZtsu2suqdxzCKfRGRmjfTVszf98ssvv/zy
ayC+KP/53o/SaHiAMq98BqXxfDnlqQLzNCi3BaVB9DyloRLAsNw2CPg6Zbj4S5SGxlmUBtfp1byZ
f1imnd4kxuvLP8nd0hel3BF/lNLAuJ/SKFqxUX3AwsBhlMbJy5S1E46nLF7XbR+U/4AHcGgP5/AT
lAbUi5Q79hdRGmNtHWslX6vXsLp9rpHlHqI0JJ6mrFdxMmUId32M61I6GJ7L1zWUueOHZv0b9fK6
mZ/SeLk8r5UZWe9EylMe1mhQZghwYsY8g/J0ij8BH2qxn1oD/Yks82/KXeOfAqvW5e12vivbfpfb
dmrz+FbK/Ne3mX9s5h9Vl74cpdH9GOW7MInSWbNA5r+mQV1DKXe8/0vXnP2dKR1mAexfl/8mYGaT
uPaoP27K97PZvneldI68lHlm1m1fA7giP+vnKZ2IGzbaT6XM5pRG7It5nf6J0sCtfSZDG5RZCzij
wfV9YvVazWv4JGBC5nmJ8v3+LbB6g3qnNdtnD9fB5BZ5auez/lz9lJ6/190+gyw7T37el+Y1PyOP
7ybga8DCvfm+1tU9krIeyX35Ob5K6ai8KWNeucX3p9Vr/7rjHtNGLAv2dH798uvt8FJEb58KZWZm
ZmbWtyQdSRkJsWm0uKNsZmZvLe50MDMzM7M3jaT3RsRjdWlrUUYLvES5S9/O4oFmZvYW4DUdzMzM
zOzNNF7SfZTpBC9SpiJsRRlyv7s7HMzM5i4e6WBmZmZmbxpJP6YshLo8MJiyOOI44KiIuKFVWTMz
e+txp4OZmZmZmZmZdYSnV5hZN2eccUbsuuuu/R2GmZmZmZkNXN2ek9vIPJ2Owszeel544YX+DsHM
zMzMzOYC7nQwMzMzMzMzs45wp4OZmZmZmZmZdYQ7HczMzMzMzMysI9zpYGZmZmZmZmYd4U4HMzMz
MzMzM+sIdzqYmZmZmZmZWUe408HMzMzMzMzMOsKdDmZmZmZmZmbWEe50MDMzMzMzM7OOcKeDmZmZ
mZmZmXWEOx3MzMzMzMzMrCPc6WBmZmZmZmZmHeFOBzMzMzMzMzPrCHc6mJmZmZmZmVlHuNPBzMzM
zMzMzDrCnQ5mZmZmZmZm1hHudDAzMzMzMzOzjnCng5mZmZmZmZl1hDsdzMzMzMzMzKwj3OlgZmZm
ZmZmZh3hTgczMzMzMzMz6wh3OpiZmZmZmZlZR7jTwczMzMzMzMw6YlB/B2BmA8/ER6cz7ODL+jsM
MzMzMzMDph7xyf4OYbZ5pIOZmZmZmZmZdYQ7HczMzMzMzMysI9zpYGZmZmZmZmYd4U4HMzMzMzMz
M+sIdzqYmZmZmZmZWUe408HMzMzMzMzMOsKdDmZmZmZmZmbWEQOi00HSa5LGS5ok6R5JX5fU57FJ
ul7SiL6ut8X+9pa0Sx/Xua6kiZImSzpWknrIP0jSfyUd3mb9G0naoI18h0oKSStV0r6WaSPy/VRJ
S7ZR146SJuTrFklrVbZtIemBPN6DK+n7Z1pU9yFpMUmX5HU0SdJulW1XSvqfpEvr9t+srl7H1eT4
mtW/kaTpee2Pl/TDunLzSrq7Gq+k3+d+/y7pt5Lmy3Tl9TA5412nUua1yj4ubhWrmZmZmZlZXxoQ
nQ7ASxExPCI+AHwC2Ao4pJ9j6lE29Jqew4g4KSLO7OPdngjsBaycry16yL8Z8ADw+Z46KNJGQI+d
DmkisEPl/fbAvW2WrfoX8LGIWBP4CXAKlEY3cDywJbA6MFrS6lnmZmBT4KG6uvYD7o2ItSjH8nNJ
8+e2o4CdG+y/WV2zE1cjzeoHuDGv/eER8eO6bQcC99Wl/R5YFVgDWAjYI9O3pOua2ItyndS8VNnH
1i3iNDMzMzMz61MDpdPhDRHxBKXRtH826ueVdJSkO/IO7pdreSV9q5L+o0wbJul+SWdk+nmSFm62
v2b1Sxos6VpJd+XIgm0q9d8n6QTgLmBZSc9LOizvro+TtHTmPVTSN/P36yUdKel2Sf+QtGGmLyzp
nNz32ZJuU5PRGJKWARaNiFsjIoAzgW17OKWjgWOAh4H1K3W9MQpB0oiMbxiwN/C1vCu+oaTl8zxM
yJ/LVer+E1A7LysC04Ene4inm4i4JSKeybfjgKH5+0hgckRMiYgZwNja/iLi7oiY2qg6YJHsYBkM
PA3MzDLXAs812H/DumYnribH1yzWpiQNBT4JnFpX1+WRgNsrMW0DnJmbxgHvzOulN/vcS9Kdku58
7cXpvSlqZmZmZmbW0IDrdACIiCmU2N4N7A5Mj4gPAR8C9pS0gqTNKHd1RwLDgXUlfTSreD9wSt6h
fhbYt8XuGtYPvAxsFxHrABtT7pjXRgq8n9LAWzsiHgLeAYzLu+s3AHs22degiBgJfJWukRz7As9U
7qav2yLWIcC0yvtpmdaQpIWATYBLgT9SOiCayobxScDReVf8RuC4PNY1KXfZj60UeRZ4RNIHs+6z
W9Xfpt2BK/L3IcAjlW0tjzcdB6wGPEYZiXFgRLw+AOJq5sPZWXWFpA9U0n8JfBtoGHtOq9gZuLKN
mBbMzoRxkpp2UkXEKRExIiJGzLvwYrN5OGZmZmZmZl0GZKdDqjXwNwN2kTQeuA1YgtLZsFm+7qaM
OFg10wEeiYib8/ffAaNa7KdZ/QL+T9IE4BpKA27pLPNQ3k2umUFp2AP8DRjWZF8XNMgzinKnnIj4
OzChRayNpkdEi/yfAq6LiBeB84HtcmpAb3wY+EP+fhbdz+VYyhSLbYELe1n3LCRtTGncH1RLapCt
1fECbA6MB95L6Yw6TtKiAyCuRu4Cls/Oql9RRo4g6VPAExHxtxZlTwBuyI6hnmJaLiJGAF8Efinp
fbMRq5mZmZmZWa8N6u8AGsmh+q8BT1AaU1+JiKvq8mwOHB4RJ9elD6N7A7BVg7BZ/WOApYB1I+JV
SVOBBXPzC3V1vJrD3cm4m53XVxrkaWedhZppdA2nJ39/rEX+0cBHMnYoHSobUzpRZtLV6bRg96JN
1Z/LSyhrJdwZEc+2t2xEd5LWpEwl2DIinsrkacCylWw9HS/AbsAR+XlMlvQvSofU7f0cVzcR8Wzl
98slnZBTXj4CbC1pK8pns6ik30XEThnTIZRr88uV6prGFBG1n1MkXQ+sDTzY23jNzMzMzMx6a8CN
dJC0FGWI/3HZcLwK2Eddq/SvIukdmf4lSYMzfYikd2c1y0n6cP4+GripxS6b1b8Y5W7zq3mne/m+
PdI33AR8Pve9OmWBwIYi4nHgOUnr51SPXYCLGuXNu/ujKHe5h0XEMMoii7UpFlPpmsrx2UrR54BF
Ku9voWuxyB2pO5cR8RJlBMBhrQ6ylVwn4gJg54j4R2XTHcDKOZ1m/oyjp6cvPEyZUkKurfF+YMoA
iKtR/e+pTdmRNJLyfXwqIr4TEUPzM9sB+Eulw2EPymiO0XXTRi6mjNiRpPUpU4Yel7S4pAWybK1D
Y3YW+zQzMzMzM+u1gdLpsFAuXDiJchf+auBHue1USiPpLkl/B06mrI1wNWXY/62SJgLn0dVYvg/Y
NadGvItZV/K/TNK0fJ3brH7K+gUjJN1JaWzf36FjPwFYKmM9iDK9otUqfvtkzJMpd6uvaJLvM5TG
6iuVtIsod9AXoJzfYyTdSBl5UXMJZRrG+Fzs8gBgt4xvZ8oTFWYREWMj4q4mcUyonO9fNMnzQ8oo
jBNyv3dmvTOB/SkdQ/cB50TEJABJB0iqjfyYIKm24OJPgA3ymrgWOCgi/ptlbgTOBTbJeDbvoa5e
x9VIi/q3B/4u6R7KWhk7VEbMNHMSZZrPrZr1MZuXUzpXJgO/pmsdk9WAO3Mf11FGgbjTwczMzMzM
3hTquY3z1pLTKy6NiA/2cyhtyTUW5ouIl3Ou/bXAKvlUBLN+sc/3Do8rXluzv8MwMzMzMzNg6hGf
7O8QGmlrbv2AXNPhbWZh4Lqc3iFgH3c4mJmZmZmZ2dxgrut0yMc+viVGOQBExHPAiPp0SbcBC9Ql
7xwRExvkPZ4yV7/qmIg4rc8C7QOSdqP79IybI2K//oinr0m6EFihLvmg+kVKzczMzMzM3i7muk6H
uUVErNeLvG+JRnt2ggyojpC+FBHb9XcMZmZmZmZmA8lAWUjSzMzMzMzMzOYyHulgZt2sMWQxTtx3
QC5WY2ZmZmZmbyEe6WBmZmZmZmZmHeFOBzMzMzMzMzPrCHc6mJmZmZmZmVlHuNPBzMzMzMzMzDrC
C0maWTcTH53OsIMv6+8wzMzMzKyFqUd44W8b+DzSwczMzMzMzMw6wp0OZmZmZmZmZtYR7nQwMzMz
MzMzs45wp4OZmZmZmZmZdYQ7HczMzMzMzMysI9zpYGZmZmZmZmYd4U4HMzMzMzMzM+sIdzqYmZmZ
mZmZWUcMiE4HSa9JGi9pkqR7JH1dUp/HJul6SSP6ut4W+9tb0i59XOe6kiZKmizpWEnqIf8gSf+V
dHib9W8kaYM28h0qKSStVEn7WqaNyPdTJS3ZRl07SpqQr1skrVXZtoWkB/J4D66k759pUd2HpMUk
XZLX0SRJu1W2XSnpf5Iurdt/s7p6HVeT42tW/0aSpue1P17SDzN9QUm3V47hR5Uyp0v6V6XM8ExX
Xg+TM951KmWWk3S1pPsk3SseScICAAAgAElEQVRpWE+fiZmZmZmZWV8YEJ0OwEsRMTwiPgB8AtgK
OKSfY+pRNvSansOIOCkizuzj3Z4I7AWsnK8tesi/GfAA8PmeOijSRkCPnQ5pIrBD5f32wL1tlq36
F/CxiFgT+AlwCoCkeYHjgS2B1YHRklbPMjcDmwIP1dW1H3BvRKxFOZafS5o/tx0F7Nxg/83qmp24
GmlWP8CNee0Pj4gfZ9orwMfzGIYDW0hav1LmW5Uy4zNtS7quib0o10nNmcBREbEaMBJ4okWsZmZm
ZmZmfWagdDq8ISKeoDSa9s9G/bySjpJ0R97B/XItr6RvVdJ/lGnDJN0v6YxMP0/Sws3216x+SYMl
XSvprhxZsE2l/vsknQDcBSwr6XlJh+Wd6XGSls68h0r6Zv5+vaQj8w72PyRtmOkLSzon9322pNvU
ZDSGpGWARSPi1ogISmNy2x5O6WjgGOBh4I2GqyqjECSNyPiGAXsDX8u76BtKWj7Pw4T8uVyl7j8B
tfOyIjAdeLKHeLqJiFsi4pl8Ow4Ymr+PBCZHxJSImAGMre0vIu6OiKmNqgMWyQ6WwcDTwMwscy3w
XIP9N6xrduJqcnzNYm2WPyLi+Xw7X76ih2LbAGdm2XHAOyUtk50hgyLiz1n38xHxYqMKJO0l6U5J
d7724vR2wzUzMzMzM2tqwHU6AETEFEps7wZ2B6ZHxIeADwF7SlpB0maUu7ojKXeD15X00azi/cAp
eYf6WWDfFrtrWD/wMrBdRKwDbEy5Y14bKfB+SgNv7Yh4CHgHMC7vTN8A7NlkX4MiYiTwVbpGcuwL
PFO5m75ui1iHANMq76dlWkOSFgI2AS4F/kjpgGgqG8YnAUfnXfQbgePyWNcEfg8cWynyLPCIpA9m
3We3qr9NuwNX5O9DgEcq21oebzoOWA14jDIS48CIeH0AxNXMh7Oz6gpJH6glZmfYeMqohD9HxG2V
ModlJ9DRkhboIaZVgP9JukDS3dnBNm+jQCLilIgYEREj5l14sdk8HDMzMzMzsy4DstMh1Rr4mwG7
ZAPsNmAJSmfDZvm6mzLiYNVMB3gkIm7O338HjGqxn2b1C/g/SROAaygNuKWzzEN5N7lmBqVhD/A3
YFiTfV3QIM8oyp1yIuLvwIQWsTaaHtHqDvingOvyzvb5wHbNGpwtfBj4Q/5+Ft3P5VjKFIttgQt7
WfcsJG1MadwfVEtqkK2nO/6bA+OB91I6o46TtOgAiKuRu4Dls7PqV5SRI6WyiNciYjhldMXI7NgB
+A7lWv8Q8K42YhoEbAh8M8usCIyZjVjNzMzMzMx6bUB2OuRQ/dcod3kFfKUyh32FiLg60w+vpK8U
Eb/JKuobgK0ahM3q3xFYClg3G3//ARbMMi/U1fFqTncg4x7UZF+vNMjTzjoLNdPoGuJP/v5Yi/yj
gU0lTaV0dCxBGbUBZcpB7fNfsHvRpurP5SWUdRIejohne1HPLCStCZwKbBMRT2XyNGDZSraejhdg
N+CCnGYwmbIuw6oDIK5uIuLZ2jSKiLgcmE91C29GxP+A68m1OyLi8Ty2V4DTKCN9WsU0Dbg7p4LM
pHRsrIOZmZmZmdmbYMB1OkhaijLE/7hsyF8F7CNpvty+iqR3ZPqXJA3O9CGS3p3VLCfpw/n7aOCm
FrtsVv9iwBMR8Wre6V6+b4/0DTcBn899rw6s0SxjRDwOPCdp/ZzqsQtwUaO8eXd/FLBcRAyLiGGU
RRZrUyym0jWV47OVos8Bi1Te30LXYpE7UncuI+Ilyt32w1odZCu5TsQFwM4R8Y/KpjuAlXM6zfwZ
x8U9VPcwZUoJubbG+4EpAyCuRvW/pzZlR9JIyvfxKUlLSXpnpi9EWYTy/ny/TP4UZXTJ37O6iykj
dqSy6OT0vF7uABbP7xXAx5m9xT7NzMzMzMx6rdkd+TfbQjm9YT7KHfizgF/ktlMpUxHuyobWk8C2
EXG1pNWAW7Pd9jywE2UUwX3ArpJOBv7JrCv5Xybp1fz9VuALjeqnrF9wiaQ7KcP17+/AcQOcAJyR
0zjupkyvaLWK3z7A6cBClDUGrmiS7zPAX/KOeM1FwM9yHYAfAb+R9F3KtJKaS4DzVBbO/ApwAPBb
Sd+inJvdqBMRY1vEO0FSbU2FcyLi6w3y/JAyCuOE/Cxn5toCMyXtT+kYmhf4bURMApB0APBt4D25
j8sjYg/KuhinS5pIGUVyUET8N8vcSBn1MFjSNGD3iLiqRV29jquRFvVvT+nwmgm8BOwQEZEdC2fk
VJh58rzVpu/8PjsQRLku9870yylPfZkMvEh+ThHxmspiptfm9f034NfNYjUzMzMzM+tL6poVMHdQ
eQLDpRHxwR6yDgjZsJwvIl6W9D7gWmCVfCqCWb/Y53uHxxWvrdnfYZiZmZlZC1OP+GR/h2Bvb20t
FTBQRjq8nS0MXJfTOwTs4w4HMzMzMzMzmxvMdZ0O+djHt8QoB4CIeA4YUZ8u6TZggbrknSNiYoO8
xwMfqUs+JiJO67NA+4Ck3YAD65Jvjoj9+iOevibpQmCFuuSDIuKq/ojHzMzMzMysv811nQ5zi4hY
rxd53xKN9uwEGVAdIX0pIrbr7xjMzMzMzMwGEnc6mFk3awxZjBP39RxBMzMzMzObMwPukZlmZmZm
ZmZmNndwp4OZmZmZmZmZdYQ7HczMzMzMzMysI9zpYGZmZmZmZmYd4YUkzaybiY9OZ9jBl/V3GGZm
Zm9LU4/wYs5mNvfwSAczMzMzMzMz6wh3OpiZmZmZmZlZR7jTwczMzMzMzMw6wp0OZmZmZmZmZtYR
7nQwMzMzMzMzs45wp4OZmZmZmZmZdYQ7HczMzMzMzMysI9zpYGZmZmZmZmYd0Vang6SlJf1B0hRJ
f5N0q6TtJG0kabqk8ZImSLpG0ruzzBhJIWmTSj3bZdr2cxq4pBGSjm2ybaqkJVuU3ULSA5ImSzq4
jX0tJelVSV9uM7ZtJa3eRr7TJb0oaZFK2jF5jpbM98+3uc+vS7o3P4drJS1f2barpH/ma9dK+mGS
Hqnfh6TlJF0n6e6sb6tMXyLTn5d0XF2ZZnX1Oq4mx9es/jGSnsxrcLykPeq2Lyrp0Vq8khaWdJmk
+yVNknREJe8Cks7O6+I2ScMyfZiklyr7OKlVrH1J0vWSRsxJHknrSpqYx3WsJPV9pGZmZmZmZt31
2OmQDZQ/ATdExIoRsS6wAzA0s9wYEcMjYk3gDmC/SvGJwOjK+x2Ae+Y0aEmDIuLOiDhgNsrOCxwP
bAmsDoxuo4Pgc8A4Zj2WVrbNutsxGdgmY5sH2Bh4tM2yVXcDI/JzOA/4Wdb5LuAQYD1gJHCIpMWz
zCWZVu/7wDkRsTblMzsh018GfgB8s0GZZnXNTlyNNKsf4Oy8BodHxKl1234C/LUu7f9FxKrA2sBH
JG2Z6bsDz0TESsDRwJGVMg9W9rF3izgHohOBvYCV87VF/4ZjZmZmZmZvF+2MdPg4MCMi3ri7GxEP
RcSvqpmyc2IR4JlK8o3ASEnzSRoMrASMb7UzSVvlXeib8q7spZl+qKRTJF0NnJmjLGrblpB0dd6Z
PxlodSd3JDA5IqZExAxgLNnob2E08A1gqKQhlVifr/y+fY5c2ADYGjgq74q/T9JwSePybv+FdY3r
PwJfyN83Am4GZvYQTzcRcV1EvJhvx9HVKbQ58OeIeDoingH+TDY6I2JcRDzeqDpg0fx9MeCxzP9C
RNxE6Xyo33/DumYnribH1yzWpiStCywNXF2p58WIuC5/nwHcVYlpG+CM/P08YJPZGRWQI0GOVBkV
dI2kkTkaYYqkrTPPgpJOyxEId0vaONMXkjQ2r5WzgYUq9W6mMsroLknn5neqp1iWARaNiFsjIoAz
KZ1ijfLuJelOSXe+9uL03h62mZmZmZlZN+10OnyA0jBrZkNJ44GHgU2B31a2BXANpYG5DXBxqx1J
WhA4GdgyIkYBS9VlWRfYJiK+WJd+CHBT3pm/GFiuxW6GAI9U3k/LtGYxLQu8JyJuB86hq4OgoYi4
JWP4Vt4Vf5DS0Dso7/ZPzHhr/gkslR0RoymdIHNqd+CK/L1Xx5sOBXaSNA24HPhKH8TUF3E189ls
pJ+Xn1dt1MjPgW81KyTpncCngWvrY4qImcB0YInctkJ2DvxV0oY9xPMO4PocFfQc8FPgE8B2wI8z
z365nzUon/sZef3vA7yY18phlGselek23wc2jYh1gDuBr/d4ZsoxTau8b3qeI+KUiBgRESPmXXix
Nqo2MzMzMzNrrdcLSUo6XtI9ku7IpNr0imWB08jh8xVjKUP0d6Dc1W9lVWBKRPwr39fnvzgiXmpQ
7qPA7wAi4jJmHW3R7RAapEWL/DtQOhugHEu7UyzKzqTFgHdGRG2I/xkZb9UFuZ/1KKNDZpuknYAR
wFG1pAbZWh0vlGM8PSKGAlsBZ2Ujvr/jauQSYFg20q+ha6TCvsDlEfFIo0KSBlGur2MjYkoPMT0O
LJedWl8H/iBp0QZ5a2YAV+bvE4G/RsSr+fuwTB8FnAUQEfcDDwGrMOu1PAGYkPnXp0zZuTk7+XYF
3lgfo4W+Os9mZmZmZma9NqiNPJOAz9beRMR+edf1zgZ5LwbOryZExO2SPgi8FBH/6GG0ek9D2V9o
sa3dhtQ0YNnK+6Hk9IEmRgNLS9ox379X0soR8c+6fS7Y5v4bGUsZTXJGRLw+u+v8SdoU+B7wsYh4
JZOnUaZt1AwFru+hqt3pmoJxa96BXxJ4op/j6iYinqq8/TVd6zB8mDIKZ19gMDC/pOcjorZw6CnA
PyPil5XytWtjWnZKLAY8ndMSXsn9/U3Sg5QOgkbfAYBXswzA65Wyr2e90Ppab3QtizIdpVedXpRj
Glp539P1bmZmZmZm1mfauXv9F2BBSftU0hZukncU8GCD9O8A321jX/cDKyqfGkAPUxkqbgB2BMhF
AVstSHgHsLKkFSTNTxlh0HDah6T3A++IiCERMSwihgGHZxmA/0haLUcBbFcp+hxlfQsiYjrwTGVI
/s7ULWwYEQ9TGuUnMJskrU2ZmrJ1RFQ7B64CNpO0eE7h2CzTWnkY2CTrXY3SofLkAIirUf3LVN5u
DdwHEBE7RsRy+Zl9Eziz1uEg6aeUDoWv1lV3MWUEAcD2wF8iIlSeXjJvll2RshjjFOZM9ZpdhTIl
6IG69A8Ca2b+cZRFL1fKbQtnuZZyHYznJK2f61PsAlw0h7GbmZmZmZm1pcdOh7xjuy3wMUn/knQ7
ZQj7QZllw1ww8R5Kg/obDeq4orZ4Xw/7eokyLP5KSTcB/6HMq+/Jj4CPSrqL0nh9uMU+ZgL7Uxq4
91Ge0jCpSfbRwIV1aefTNcXiYOBSSsdMdZHDscC3cg2A91EaskdJmgAMp2tefzWuk3P9h3oLS5pW
eTWbx38U5Y7+ufl5XJz1Pk15gsMd+fpxpiHpZ7luQ20fh2Zd3wD2zM/0j8CY2p17SVOBXwBjsszq
PdTV67gaaVH/ASqPvrwHOAAY06yOrGcopYNndeAuzfqYzd8AS0iaTJlGURsV8VFgQu7jPGDvVrG2
6QRgXkkTgbMp5/gVypMmBue18m3gdoCIeDKP7Y+5bRxlOlI79gFOpTwp5UG61tUwMzMzMzPrKHWN
Ah8YJA2OiOfzruzxlCHwR/d3XGZvJ/t87/C44rU1e85oZmZmfW7qEZ/s7xDMzNrR1roAc7Q4YIfs
mQvlTaIMgT+5n+MxMzMzMzMzs9nQzkKSHSHpQmCFuuSDclTDHI9skLQEXY9CrNqkbvHBnuLp9ToD
nSTpe8Dn6pLPjYjD+iOevibpNmCBuuSdI2Jif8TTykCLdaDFY2ZmZmZm1m+dDhGxXc+55qj+pyjr
J7Sbv6Px9JXsXJgrOhgaiYj1+juGdg20WAdaPGZmZmZmZgNxeoWZmZmZmZmZzQX6baSDmQ1cawxZ
jBP39SJWZmZmZmY2ZzzSwczMzMzMzMw6wp0OZmZmZmZmZtYR7nQwMzMzMzMzs45wp4OZmZmZmZmZ
dYQXkjSzbiY+Op1hB1/W32GYmXXc1CO8aK6ZmVkneaSDmZmZmZmZmXWEOx3MzMzMzMzMrCPc6WBm
ZmZmZmZmHeFOBzMzMzMzMzPrCHc6mJmZmZmZmVlHuNPBzMzMzMzMzDrCnQ5mZmZmZmZm1hFtdTpI
WlrSHyRNkfQ3SbdK2k7SRpKmSxovaYKkayS9O8uMkRSSNqnUs12mbT+ngUsaIenYJtumSlqyRdkt
JD0gabKkg9vY11KSXpX05TZj21bS6m3kO13Si5IWqaQdk+doyXz/fJv7/Lqke/NzuFbS8pVtu0r6
Z752raQfJumR+n1IWk7SdZLuzvq2yvQlMv15ScfVlWlWV6/janJ8zeofI+nJvAbHS9oj05fPa3W8
pEmS9q6UuT4//1qZ2jW7gKSz87q4TdKwSpk187qfJGmipAVbxdtXMtYRc5JH0roZ82RJx0pS30dq
ZmZmZmbWXY+dDtlA+RNwQ0SsGBHrAjsAQzPLjRExPCLWBO4A9qsUnwiMrrzfAbhnToOWNCgi7oyI
A2aj7LzA8cCWwOrA6DY6CD4HjGPWY2ll26y7HZOBbTK2eYCNgUfbLFt1NzAiP4fzgJ9lne8CDgHW
A0YCh0haPMtckmn1vg+cExFrUz6zEzL9ZeAHwDcblGlW1+zE1Uiz+gHOzmtweEScmmmPAxtExPDc
x8GS3lsps2OlzBOZtjvwTESsBBwNHJmxDgJ+B+wdER8ANgJebRHrQHMisBewcr626N9wzMzMzMzs
7aKdkQ4fB2ZExEm1hIh4KCJ+Vc2UnROLAM9Ukm8ERkqaT9JgYCVgfKudSdpK0v2Sbsq7spdm+qGS
TpF0NXBmjrKobVtC0tV5Z/5koNWd3JHA5IiYEhEzgLFko7+F0cA3gKGShlRifb7y+/Y5cmEDYGvg
qLyL/j5JwyWNy7v9F9Y1rv8IfCF/3wi4GZjZQzzdRMR1EfFivh1HV6fQ5sCfI+LpiHgG+DPZ6IyI
cRHxeKPqgEXz98WAxzL/CxFxE6XzoX7/DeuanbiaHF+zWJvlnxERr+TbBWjvWt8GOCN/Pw/YJK/r
zYAJEXFP1v1URLzWrJIcCXJkjrS4RtLIHI0wRdLWmWdBSaflCIS7JW2c6QtJGpvXytnAQpV6N8vR
FndJOje/Uy1JWgZYNCJujYgAzqR0ijXKu5ekOyXd+dqL09s4XWZmZmZmZq210xD7AHBXi+0bShoP
PAxsCvy2si2AaygNzG2Ai1vtKIesnwxsGRGjgKXqsqwLbBMRX6xLPwS4Ke/MXwws12I3Q4BHKu+n
ZVqzmJYF3hMRtwPn0NVB0FBE3JIxfCvvoj9IaegdlHf7J2a8Nf8ElsqOiNGUTpA5tTtwRf7eq+NN
hwI7SZoGXA58pQ9i6ou4mvlsNtLPy88LKJ+dpAm5nyMj4rFKmdOyU+gHlekGb8QUETOB6cASwCpA
SLoqG/zf7iGedwDX56ig54CfAp8AtgN+nHn2y/2sQfncz8jrfx/gxbxWDqNc86hMt/k+sGlErAPc
CXy9jXMzhHJua5qe54g4JSJGRMSIeRderI2qzczMzMzMWuv1QpKSjpd0j6Q7Mqk2vWJZ4DRy+HzF
WMoQ/R0od/VbWRWYEhH/yvf1+S+OiJcalPsoZfg7EXEZs4626HYIDdKiRf4dKJ0NUI6l3SkWZWfS
YsA7I+KvmXRGxlt1Qe5nPcrokNkmaSdgBHBULalBtlbHC+UYT4+IocBWwFk59aO/42rkEmBYNtKv
oWukAhHxSKavBOwqaenctGM29jfM1849xDQIGAXsmD+3U2WtkgZmAFfm7xOBv0bEq/n7sEwfBZyV
cd4PPETp3KheyxOACZl/fcqUnZuzk29X4I31MVroq/NsZmZmZmbWa+00JCcB69TeRMR+wCZ0H4UA
5Q7/LA3qHCHwQWDJiPhHD/vqaYG7F1psa7chNQ1YtvJ+KDl9oInRwBhJUynHt5aklRvsc04WFhwL
/IQy3eD12a1E0qbA94CtK1MLenu8UEYknAMQEbdSjq3pwpxvYlzd5FSHWp2/JkcG1OV5jHIdb5jv
H82fzwF/oGutiDdiynUcFgOezvS/RsR/c6rI5VS+Ew28mlMZAF4HXsn9vU7pwIDW13qja1mU66O2
DsXqEbF7izpqptE1pQVm8zybmZmZmZnNjnY6Hf4CLChpn0rawk3yjgIebJD+HeC7bezrfmDFylMD
Wk5lqLiBchcaSVsCrRYkvANYWdIKkuanjDBoOO1D0vuBd0TEkIgYFhHDgMOzDMB/JK2WowC2qxR9
jrK+BRExHXhG0oa5bWfgr5W8RMTDlEb5CcwmSWtTpqZsXVkYEeAqYDNJi+cUjs0yrZWHKR1LSFqN
0unw5ACIq1H9y1Tebg3cl+lDJS2Uvy8OfAR4QNIgdT0ZZD7gU8Dfs/zFlBEEANsDf8nOg6uANSUt
nJ0RHwPu7W2sdarX7CqUKUEP1KV/EFgz848DPiJppdy2cJZrKdfBeE7S+jmNZBfgojmM3czMzMzM
rC2DesoQESFpW+DonMv+JGXEwUGZpbamgyhz4PdoUMcV9WlN9vWSpH2BKyX9F7i9vcPgR8AfJd1F
adA/3GIfMyXtT2lIzgv8NiImNck+GriwLu18ukYmHAxcSlkH4O9AbWG/scCvJR1AabzuCpwkaWFg
CrBbg7hObhLDwrm2Qs0vIuIXDfIdlfs/N5coeDgito6IpyX9hNLZAvDjiHgaQNLPgC9W9nFqRBxK
WTTz15K+RrnrPqZ25z5HfCwKzJ/XxWYRcW+LunodVyMt6j8gF2ecSRmVMCaLrAb8XFJQrs3/FxET
Jb0DuCo7HOalTMn4dZb5DWUqyeSsaweAiHhG0i8y1gAuz2k8c+IEyjUxMWMfExGvSDqRst7EBMqi
q7dnDE9KGkO5zhfIOr4P9DR6CMo6EadTFqW8gq51NczMzMzMzDpKXaPABwZJgyPi+bwrezzwz4g4
ur/jMns72ed7h8cVr63Zc0Yzs7e4qUd8sr9DMDMze6vqaXkEYDYWknwT7JkjJyZR5tQ3GwFgZmZm
ZmZmZgNYj9MrOkXShcAKdckH5aiGOR7ZIGkJ4NoGmzaJiKd6EU+v1xnoJEnfAz5Xl3xuRBzWH/H0
NUm3AQvUJe8cERP7I55WBlqsAy0eMzMzMzOzfut0iIjtes41R/U/BQzvRf6OxtNXsnNhruhgaCQi
1uvvGNo10GIdaPGYmZmZmZkNxOkVZmZmZmZmZjYX6LeRDmY2cK0xZDFO3NeLq5mZmZmZ2ZzxSAcz
MzMzMzMz6wh3OpiZmZmZmZlZR7jTwczMzMzMzMw6wp0OZmZmZmZmZtYRXkjSzLqZ+Oh0hh18WX+H
YWbWtqlHePFbMzOzgcgjHczMzMzMzMysI9zpYGZmZmZmZmYd4U4HMzMzMzMzM+sIdzqYmZmZmZmZ
WUe408HMzMzMzMzMOsKdDmZmZmZmZmbWEe50MDMzMzMzM7OOaKvTQdLSkv4gaYqkv0m6VdJ2kjaS
NF3SeEkTJF0j6d1ZZoykkLRJpZ7tMm37OQ1c0ghJxzbZNlXSki3KbiHpAUmTJR3cxr6WkvSqpC+3
Gdu2klZvI9/pkl6UtEgl7Zg8R0vm++fb3OfXJd2bn8O1kpavbNtV0j/ztWsl/TBJj9TvQ9Jykq6T
dHfWt1WmL5Hpz0s6rq5Ms7p6HVeT42tW/xhJT+Y1OF7SHpm+fF6r4yVNkrR3pcz1+fnXytSu2QUk
nZ3XxW2ShlXKrJnX/SRJEyUt2CrevpKxjpiTPM3OnZmZmZmZWaf12OkgScCfgBsiYsWIWBfYARia
WW6MiOERsSZwB7BfpfhEYHTl/Q7APXMatKRBEXFnRBwwG2XnBY4HtgRWB0a30UHwOWAcsx5LK9tm
3e2YDGyTsc0DbAw82mbZqruBEfk5nAf8LOt8F3AIsB4wEjhE0uJZ5pJMq/d94JyIWJvymZ2Q6S8D
PwC+2aBMs7pmJ65GmtUPcHZeg8Mj4tRMexzYICKG5z4OlvTeSpkdK2WeyLTdgWciYiXgaODIjHUQ
8Dtg74j4ALAR8GqLWAeaVufOzMzMzMysY9oZ6fBxYEZEnFRLiIiHIuJX1UzZObEI8Ewl+UZgpKT5
JA0GVgLGt9qZpK0k3S/pJknHSro00w+VdIqkq4Ezc5RFbdsSkq7OO/MnA2qxi5HA5IiYEhEzgLFk
o7+F0cA3gKGShlRifb7y+/Y5cmEDYGvgqLyL/j5JwyWNy7v9F9Y1rv8IfCF/3wi4GZjZQzzdRMR1
EfFivh1HV6fQ5sCfI+LpiHgG+DOwRZYZFxGPN6oOWDR/Xwx4LPO/EBE3UTof6vffsK7ZiavJ8TWL
tVn+GRHxSr5dgPau9W2AM/L384BN8rreDJgQEfdk3U9FxGvNKsmRIEfmSItrJI3M0QhTJG2deRaU
dFqOmrhb0saZvpCksXmtnA0sVKl3sxxtcZekc/M71c656NW5MzMzMzMz6yvtNMQ+ANzVYvuG+v/s
3XvUVWW99//3Z0MeEEVDswINj6kpG5Ot7cJTmKntDbLTX5C65RlmpZajRzMtbWiWwwOV5U5NrTzt
raCWPXhWPKCYCIQcIjUREVGHuZWHIeL2+P39Mb/Le7JYp/uwvO9HP68x7sFa17wO37nW5I/5ndd1
LWkesAzYD/hd6VgA0yhuMMcCUxsNlFPWLwEOjIhRwGZVVXYDxkbEV6vKTwdm5JP5qcCWDYYZAjxT
er88y+rFtAXw0YiYBVxHR4Kgpoj4U8ZwUj5FfxK4Cjg5n/YvzHgrngA2y0TEBIokSHcdBdyWrzt1
vukM4HBJy4FbgW/3QEw9EVc9X86b9Bvy+wKK707Sghzn3Ih4rtTm8kwK/TATC2vEFBFvASuBwcD2
QEi6I2/4v9ckng2A+3JW0CvAT4AvAOOAM7POcTnOLhTf+5V5/R8DrM5r5SyKax4Vy21OA/aLiE8D
c4ATOvk5NSTp65LmSGF0tBkAACAASURBVJrz9uqVPdm1mZmZmZl9QHV6I0lJF0qaL2l2FlWWV2wB
XE5Ony+ZTDFFfzzFU/1GdgCWRMRT+b66/tSIeK1Gu70opr8TEbew5myLtU6hRlk0qD+eItkAxbm0
usSiGEwaBGwcEdOz6MqMt+wPOc4eFLNDukzS4cBIYFKlqEa1RucLxTleERFDgYOAq3PpR2/HVctN
wLC8SZ9Gx0wFIuKZLN8WOFLS5nnosLzZ3zP/jmgSU39gFHBY/jtOpb1KangDuD1fLwSmR8Sb+XpY
lo8Crs44HwOepkhulK/lBcCCrP8ZiiU7D2aS70jg3f0xekJEXBoRIyNiZL8Bg3qyazMzMzMz+4Bq
5UZyEfDpypuIOA4YzdqzEKB4wr/GDXXOENgZ2DQi/tZkrEbLIgBebXCs1RvW5cAWpfdDyeUDdUwA
JkpaSnF+/yhpuxpjdmdjwcnAjymWG7zT1U4k7QecCowpLS3o7PlCMSPhOoCIeIji3OpuzPkexrWW
XOpQ6fMycmZAVZ3nKK7jPfP9s/nvK8A1dOx38G5MuY/DIODlLJ8eEf+dS0VupfR/ooY3I6JybbwD
vJ7jvUORwIDG13qta1kU10dlH4qdIuKoBn2YmZmZmZn1ulaSDvcA60k6plQ2oE7dUcCTNcq/D/yg
hbEeA7Yu/WpAw6UMJfdTPIVG0oFAow0JZwPbSdpK0joUMwxqLvuQ9Elgg4gYEhHDImIYcHa2AXhB
0o45C2BcqekrFPtbEBErgRWS9sxjRwDTS3WJiGUUN+UX0UWSdqVYmjKmtDEiwB3A/pI2ySUc+2dZ
I8soEktI2pEi6fBiH4irVv8fK70dAzya5UMlrZ+vNwE+Bzwuqb86fhnkQ8C/AH/J9lMpZhAAHALc
k8mDO4DhkgZkMmJv4K+djbVK+ZrdnmJJ0ONV5TsDw7P+TOBzkrbNYwOynZmZmZmZWZ/VNOmQN10H
A3tLekrSLIop7CdnlT1zbfx8ihvqE2v0cVtE3NvCWK8BxwK3S5oBvECxrr6ZHwF7SZpLcfO6rMEY
bwHforiRfJTiVxoW1ak+Abixquz3dCyxOAW4mSIxU96obzJwUm4QuA3Fjeyk3F9gBB3r+stxXZL7
P1QbIGl56a/eOv5JwEDg+vw+pma/L1PMopidf2dmGZLOy30bKmOckX2dCByd3+m1wMTKk/uc8fFz
itkfy5W//NGgr07HVUuD/o9X8TOW84HjgYlZviPwcJZPB34aEQspNpW8I7+LeRS/FHJZtvktMFjS
Yor9Ek7JWFfkOc/ONnNzGU93XAT0k7QQmELxGb8OXAwMzPi+B8zKGF7Mc7s2j82kWI7UVIPPzszM
zMzMrK3UMQu8b5A0MCJW5eZ+FwJPRMT5vR2X2QfJMaeeHbe9Pbx5RTOzPmLpOV/q7RDMzMw+aJpt
jwB0YSPJ98DRuVHeIoo19Zf0cjxmZmZmZmZm1gX9m1dpD0k3AltVFZ+csxq6PbNB0mDg7hqHRkfE
S52Ip9P7DLSTpFOBQ6uKr4+Is3ojnp4m6WGKJRBlR+TSiD6lr8Xa1+IxMzMzMzPrtaRDRIxrXqtb
/b9EsX9Cq/XbGk9PyeTC+yLBUEtE7NHbMbSqr8Xa1+IxMzMzMzPri8srzMzMzMzMzOx9oNdmOphZ
37XLkEFcfKw3ZTMzMzMzs+7xTAczMzMzMzMzawsnHczMzMzMzMysLZx0MDMzMzMzM7O2cNLBzMzM
zMzMzNrCG0ma2VoWPruSYafc0tthmJmtYek53uDWzMzs/zWe6WBmZmZmZmZmbeGkg5mZmZmZmZm1
hZMOZmZmZmZmZtYWTjqYmZmZmZmZWVs46WBmZmZmZmZmbeGkg5mZmZmZmZm1hZMOZmZmZmZmZtYW
TjqYmZmZmZmZWVu0lHSQtLmkayQtkfRnSQ9JGidpH0krJc2TtEDSNEkfyTYTJYWk0aV+xmXZId0N
XNJISRfUObZU0qYN2h4g6XFJiyWd0sJYm0l6U9I3WoztYEk7tVDvCkmrJW1YKvtlfkab5vtVLY55
gqS/5vdwt6RPlI4dKemJ/DuyVH6WpGeqx5C0paR7JT2S/R2U5YOzfJWkX1W1qddXp+Oqc371+p8o
6cW8BudJ+lqWfyKv1XmSFkn6ZqnNffn9V9pUrtl1JU3J6+JhScNKbYbndb9I0kJJ6zWKt6dkrCO7
WkfSAEm3SHosYz+nPZGamZmZmZmtrWnSQZKAPwL3R8TWEbEbMB4YmlUeiIgRETEcmA0cV2q+EJhQ
ej8emN/doCX1j4g5EXF8F9r2Ay4EDgR2Aia0kCA4FJjJmufSyMHZdysWA2Mztn8A9gWebbFt2SPA
yPwebgDOyz4/DJwO7AHsDpwuaZNsc1OWVTsNuC4idqX4zi7K8v8Bfgh8t0aben11Ja5a6vUPMCWv
wRER8Zssex74bESMyDFOkfTxUpvDSm3+nmVHASsiYlvgfODcjLU/8J/ANyPiU8A+wJsNYu1rfhoR
OwC7Ap+TdGBvB2RmZmZmZh8Mrcx0+DzwRkT8ulIQEU9HxH+UK2VyYkNgRan4AWB3SR+SNBDYFpjX
aDBJB+VT2RmSLpB0c5afIelSSXcCV+Usi8qxwZLuzCfzlwBqMMTuwOKIWBIRbwCTyZv+BiYAJwJD
JQ0pxbqq9PqQnLnwWWAMMCmfom8jaYSkmfm0/8aqm+trga/k632AB4G3msSzloi4NyJW59uZdCSF
vgjcFREvR8QK4C7ggGwzMyKer9UdsFG+HgQ8l/VfjYgZFMmH6vFr9tWVuOqcX71Y69V/IyJez7fr
0tq1Pha4Ml/fAIzO63p/YEFEzM++X4qIt+t1kjNBzs2ZFtMk7Z6zEZZIGpN11pN0ec6aeETSvlm+
vqTJea1MAdYv9bt/zraYK+n6/D/V7HNYHRH3Vj4TYC4d30F13F+XNEfSnLdXr2z+aZmZmZmZmTXR
yo3YpyhuVOrZU9I8YBmwH/C70rEAplHcYI4FpjYaKKesXwIcGBGjgM2qquwGjI2Ir1aVnw7MyCfz
U4EtGwwzBHim9H55ltWLaQvgoxExC7iOjgRBTRHxp4zhpHyK/iRwFXByPu1fmPFWPAFslomICRRJ
kO46CrgtX3fqfNMZwOGSlgO3At/ugZh6Iq56vpw36Tfk9wUU352kBTnOuRHxXKnN5ZkU+mEmFtaI
KSLeAlYCg4HtgZB0R97wf69JPBsA9+WsoFeAnwBfAMYBZ2ad43KcXSi+9yvz+j8GWJ3XylkU1zwq
ltucBuwXEZ8G5gAndOZDkrQx8K/A3bWOR8SlETEyIkb2GzCoM12bmZmZmZnV1OmNJCVdKGm+pNlZ
VFlesQVwOTl9vmQyxRT98RRP9RvZAVgSEU/l++r6UyPitRrt9qKY/k5E3MKasy3WOoUaZdGg/niK
ZAMU59LqEotiMGkQsHFETM+iKzPesj/kOHtQzA7pMkmHAyOBSZWiGtUanS8U53hFRAwFDgKuzqUf
vR1XLTcBw/ImfRodMxWIiGeyfFvgSEmb56HD8mZ/z/w7oklM/YFRwGH57ziV9iqp4Q3g9ny9EJge
EW/m62FZPgq4OuN8DHiaIrlRvpYXAAuy/mcoluw8mEm+I4F398doJpeIXAtcEBFLWm1nZmZmZmbW
Ha3cSC4CPl15ExHHAaNZexYCFE/417ihzhkCOwObRsTfmozVaFkEwKsNjrV6w7oc2KL0fii5fKCO
CcBESUspzu8fJW1XY8zubCw4GfgxxXKDd7raiaT9gFOBMaWlBZ09XyhmJFwHEBEPUZxb3Y0538O4
1pJLHSp9XkbODKiq8xzFdbxnvn82/30FuIaOvSLejSlv0gcBL2f59Ij471wqciul/xM1vBkRlWvj
HeD1HO8digQGNL7Wa13Lorg+KvtQ7BQRRzXoo9qlwBMR8YtOtDEzMzMzM+uWVpIO9wDrSTqmVDag
Tt1RwJM1yr8P/KCFsR4Dti79akDDpQwl91M8hSY3yWu0IeFsYDtJW0lah2KGQc1lH5I+CWwQEUMi
YlhEDAPOzjYAL0jaMWcBjCs1fYVifwsiYiWwQtKeeewIYHqpLhGxjOKm/CK6SNKuFEtTxpQ2RgS4
A9hf0ia5hGP/LGtkGUViCUk7UiQdXuwDcdXq/2Olt2OAR7N8qKT18/UmwOeAxyX1V8cvg3wI+Bfg
L9l+KsUMAoBDgHsyeXAHMFzFL0H0B/YG/trZWKuUr9ntKZYEPV5VvjMwPOvPpNgEcts8NiDbNSXp
JxQJlO90M2YzMzMzM7NOaZp0yJuug4G9JT0laRbFFPaTs8qeuTZ+PsUN9Yk1+ritspldk7FeA44F
bpc0A3iBYl19Mz8C9pI0l+LmdVmDMd4CvkVxI/koxa80LKpTfQJwY1XZ7+lYYnEKcDNFYqa8yeFk
4KTcIHAbihvZSbm/wAg61vWX47ok93+oNkDS8tJfvXX8k4CBwPX5fUzNfl+mmEUxO//OzDIknZf7
NlTGOCP7OhE4Or/Ta4GJlSf3OePj5xSzP5Yrf/mjQV+djquWBv0fr+KnIOcDxwMTs3xH4OEsn07x
Cw4LKTaVvCO/i3kUvxRyWbb5LTBY0mKK/RJOyVhX5DnPzjZzcxlPd1wE9JO0EJhC8Rm/DlwMDMz4
vgfMyhhezHO7No/NpFiO1JCkoRQJrZ2AuSr9rKiZmZmZmVm7qWMWeN8gaWBErMrN/S6kmBJ+fm/H
ZfZBcsypZ8dtbw9vXtHM7D209Jwv9XYIZmZm1qHZ9ghAFzaSfA8cnRvlLaKYEn5JL8djZmZmZmZm
Zl3Qv3mV9pB0I7BVVfHJOauh2zMbJA2m9k8Djo6IlzoRT6f3GWgnSacCh1YVXx8RZ/VGPD1N0sMU
SyDKjsilEX1KX4u1r8VjZmZmZmbWa0mHiBjXvFa3+n+JYv+EVuu3NZ6eksmF90WCoZaI2KO3Y2hV
X4u1r8VjZmZmZmbWa0kHM+u7dhkyiIuP9dppMzMzMzPrnr64p4OZmZmZmZmZvQ846WBmZmZmZmZm
beGkg5mZmZmZmZm1hZMOZmZmZmZmZtYWTjqYmZmZmZmZWVv41yvMbC0Ln13JsFNu6e0wzLpk6Tn+
5RUzMzOzvsIzHczMzMzMzMysLZx0MDMzMzMzM7O2cNLBzMzMzMzMzNrCSQczMzMzMzMzawsnHczM
zMzMzMysLZx0MDMzMzMzM7O2cNLBzMzMzMzMzNqipaSDpM0lXSNpiaQ/S3pI0jhJ+0haKWmepAWS
pkn6SLaZKCkkjS71My7LDulu4JJGSrqgzrGlkjZt0PYASY9LWizplBbG2kzSm5K+0WJsB0vaqYV6
V0haLWnDUtkv8zPaNN+vanHMEyT9Nb+HuyV9onTsSElP5N+RpfKzJD1TPYakLSXdK+mR7O+gLB+c
5ask/aqqTb2+Oh1XnfOr1/9ESS/mNThP0teqjm8k6dlKvJIGSLpF0mOSFkk6p1R3XUlT8rp4WNKw
LB8m6bXSGL9uFGtPknSfpJHdrZP1pkr6S89FZ2ZmZmZm1ljTpIMkAX8E7o+IrSNiN2A8MDSrPBAR
IyJiODAbOK7UfCEwofR+PDC/u0FL6h8RcyLi+C607QdcCBwI7ARMaCFBcCgwkzXPpZGDs+9WLAbG
Zmz/AOwLPNti27JHgJH5PdwAnJd9fhg4HdgD2B04XdIm2eamLKt2GnBdROxK8Z1dlOX/A/wQ+G6N
NvX66kpctdTrH2BKXoMjIuI3Vcd+DEyvKvtpROwA7Ap8TtKBWX4UsCIitgXOB84ttXmyNMY3G8TZ
J0n6N6ClBJaZmZmZmVlPaWWmw+eBNyLi3ae7EfF0RPxHuVImJzYEVpSKHwB2l/QhSQOBbYF5jQaT
dFA+hZ4h6QJJN2f5GZIulXQncFXOsqgcGyzpznwyfwmgBkPsDiyOiCUR8QYwmbzpb2ACcCIwVNKQ
UqyrSq8PyZkLnwXGAJPyqfg2kkZImplP+2+surm+FvhKvt4HeBB4q0k8a4mIeyNidb6dSUdS6IvA
XRHxckSsAO4CDsg2MyPi+VrdARvl60HAc1n/1YiYQZF8qB6/Zl9diavO+dWLtS5JuwGbA3eW+lkd
Effm6zeAuaWYxgJX5usbgNF5XXdKzgQ5V8WsoGmSds/ZCEskjck660m6XNLCvG73zfL1JU3Oa2UK
sH6p3/1VzDKaK+n6/D/VSjwDgROAnzSp93VJcyTNeXv1ys6etpmZmZmZ2VpaSTp8iuLGrJ49Jc0D
lgH7Ab8rHQtgGsUN5lhgaqOBJK0HXAIcGBGjgM2qquwGjI2Ir1aVnw7MyCfzU4EtGwwzBHim9H55
ltWLaQvgoxExC7iOjgRBTRHxp4zhpHwq/iRwFXByPu1fmPFWPAFslomICRRJkO46CrgtX3fqfNMZ
wOGSlgO3At/ugZh6Iq56vpw36Tfk91WZNfIz4KR6jSRtDPwrcHd1TBHxFrASGJzHtsrkwHRJezaJ
ZwPgvpwV9ArFzf4XgHHAmVnnuBxnF4rv/cq8/o8BVue1chbFNY+K5TanAftFxKeBORSJhFb8mOKz
WN2oUkRcGhEjI2JkvwGDWuzazMzMzMysvk5vJCnpQknzJc3Oosryii2Ay8np8yWTKaboj6d4qt/I
DsCSiHgq31fXnxoRr9VotxfwnwARcQtrzrZY6xRqlEWD+uMpkg1QnEurSyyKwaRBwMYRUZnif2XG
W/aHHGcPitkhXSbpcGAkMKlSVKNao/OF4hyviIihwEHA1XkT39tx1XITMCxv0qfRMVPhWODWiHim
ViNJ/SmurwsiYkmTmJ4Htsyk1gnANZI2qlG34g3g9ny9EJgeEW/m62FZPgq4GiAiHgOeBrZnzWt5
AbAg63+GYsnOg5nkOxJ4d3+MeiSNALaNiBub1TUzMzMzM+tp/Vuoswj4cuVNRByXT13n1Kg7Ffh9
uSAiZknaGXgtIv7WZLZ6s6nsrzY41uoN63Jgi9L7oeTygTomAJtLOizff1zSdhHxRNWY67U4fi2T
KWaTXBkR73RhRj8AkvYDTgX2jojXs3g5xbKNiqHAfU26OoqOJRgP5RP4TYG/93Jca4mIl0pvL6Nj
H4Z/ppiFcywwEFhH0qqIqGwceinwRET8otS+cm0sz6TEIODliAjg9Rzvz5KepEgQ1Po/APBmtgF4
p9T2newXGl/rta5lUSxH6VTSi+Jz2E3SUor/7x+RdF9E7NPJfszMzMzMzDqtlafX9wDrSTqmVDag
Tt1RwJM1yr8P/KCFsR4Dtlb+agBNljKU3A8cBpCbAjbakHA2sJ2krSStQzHDoOayD0mfBDaIiCER
MSwihgFnZxuAFyTtmLMAxpWavkKxvwURsRJYUZqSfwRVGxtGxDKKm/KL6CJJu1IsTRkTEeXkwB3A
/pI2ySUc+2dZI8uA0dnvjhQJlRf7QFy1+v9Y6e0Y4FGAiDgsIrbM7+y7wFWVhIOkn1AkFL5T1d1U
ihkEAIcA90REqPj1kn7ZdmtgO2AJ3VO+ZrenWBL0eFX5zsDwrD+TYtPLbfPYgGzXUERcHBEfz89h
FPA3JxzMzMzMzOy90jTpkE9sDwb2lvSUpFkUU9hPzip75oaJ8yluqE+s0cdtlc37moz1GsW0+Nsl
zQBeoFhX38yPgL0kzaW4eV3WYIy3gG9R3OA+SvErDYvqVJ8AVE9L/z0dSyxOAW6mSMyUNzmcDJyU
ewBsQ3EjO0nSAmAEHev6y3Fdkvs/VBsgaXnpr946/kkUT/Svz+9javb7MsWa/tn5d2aWIem83Leh
MsYZ2deJwNH5nV4LTKw8uc8n5j8HJmabnZr01em4amnQ//EqfvpyPnA8MLFeH9nPUIoEz07AXK35
M5u/BQZLWkyxjKIyK2IvYEGOcQPwzUaxtugioJ+khcAUis/4deBiYGBeK98DZgFExIt5btfmsZkU
y5HMzMzMzMz6LHXMAu8bJA2MiFUq1hhcSDEF/vzejsvsg+SYU8+O294e3ryiWR+09Jwv9XYIZmZm
Zh8ELe0L0K3NAdvk6NwobxHFFPhLejkeMzMzMzMzM+uCVjaSbAtJNwJbVRWfnLMauj2zQdJgOn4K
sWx01eaDzeLp9D4D7STpVODQquLrI+Ks3oinp0l6GFi3qviIiFjYG/E00tdi7WvxmJmZmZmZ9VrS
ISLGNa/Vrf5fotg/odX6bY2np2Ry4X2RYKglIvbo7Rha1ddi7WvxmJmZmZmZ9cXlFWZmZmZmZmb2
PtBrMx3MrO/aZcggLj7Wm/GZmZmZmVn3eKaDmZmZmZmZmbWFkw5mZmZmZmZm1hZOOpiZmZmZmZlZ
WzjpYGZmZmZmZmZt4Y0kzWwtC59dybBTbuntMOz/AUvP8YajZmZmZlafZzqYmZmZmZmZWVs46WBm
ZmZmZmZmbeGkg5mZmZmZmZm1hZMOZmZmZmZmZtYWTjqYmZmZmZmZWVs46WBmZmZmZmZmbeGkg5mZ
mZmZmZm1RUtJB0mbS7pG0hJJf5b0kKRxkvaRtFLSPEkLJE2T9JFsM1FSSBpd6mdclh3S3cAljZR0
QZ1jSyVt2qDtAZIel7RY0iktjLWZpDclfaPF2A6WtFML9a6QtFrShqWyX+ZntGm+X9XimCdI+mt+
D3dL+kTp2JGSnsi/I0vlZ0l6pnoMSVtKulfSI9nfQVk+OMtXSfpVVZt6fXU6rjrnV6//iZJezGtw
nqSvVR3fSNKzlXglDZB0i6THJC2SdE6p7rqSpuR18bCkYVk+TNJrpTF+3SjWniTpPkkju1On3mdn
ZmZmZmbWbk2TDpIE/BG4PyK2jojdgPHA0KzyQESMiIjhwGzguFLzhcCE0vvxwPzuBi2pf0TMiYjj
u9C2H3AhcCCwEzChhQTBocBM1jyXRg7OvluxGBibsf0DsC/wbIttyx4BRub3cANwXvb5YeB0YA9g
d+B0SZtkm5uyrNppwHURsSvFd3ZRlv8P8EPguzXa1OurK3HVUq9/gCl5DY6IiN9UHfsxML2q7KcR
sQOwK/A5SQdm+VHAiojYFjgfOLfU5snSGN9sEGdf1OizMzMzMzMza5tWZjp8HngjIt59uhsRT0fE
f5QrZXJiQ2BFqfgBYHdJH5I0ENgWmNdoMEkH5VPoGZIukHRzlp8h6VJJdwJX5SyLyrHBku7MJ/OX
AGowxO7A4ohYEhFvAJPJm/4GJgAnAkMlDSnFuqr0+pCcufBZYAwwKZ+KbyNphKSZ+bT/xqqb62uB
r+TrfYAHgbeaxLOWiLg3Ilbn25l0JIW+CNwVES9HxArgLuCAbDMzIp6v1R2wUb4eBDyX9V+NiBkU
yYfq8Wv21ZW46pxfvVjrkrQbsDlwZ6mf1RFxb75+A5hbimkscGW+vgEYndd1p+RMkHNVzAqaJmn3
nI2wRNKYrLOepMslLczrdt8sX1/S5LxWpgDrl/rdX8Uso7mSrs//U021+tlJ+rqkOZLmvL16ZWdP
28zMzMzMbC2tJB0+RXFjVs+ekuYBy4D9gN+VjgUwjeIGcywwtdFAktYDLgEOjIhRwGZVVXYDxkbE
V6vKTwdm5JP5qcCWDYYZAjxTer88y+rFtAXw0YiYBVxHR4Kgpoj4U8ZwUj4VfxK4Cjg5n/YvzHgr
ngA2y0TEBIokSHcdBdyWrzt1vukM4HBJy4FbgW/3QEw9EVc9X86b9Bvy+6rMGvkZcFK9RpI2Bv4V
uLs6poh4C1gJDM5jW2VyYLqkPZvEswFwX84KegX4CfAFYBxwZtY5LsfZheJ7vzKv/2OA1XmtnEVx
zaNiuc1pwH4R8WlgDnBC00+mEyLi0ogYGREj+w0Y1JNdm5mZmZnZB1SnN5KUdKGk+ZJmZ1FlecUW
wOXk9PmSyRRT9MdTPNVvZAdgSUQ8le+r60+NiNdqtNsL+E+AiLiFNWdbrHUKNcqiQf3xFMkGKM6l
1SUWxWDSIGDjiKhM8b8y4y37Q46zB8XskC6TdDgwEphUKapRrdH5QnGOV0TEUOAg4Oq8ie/tuGq5
CRiWN+nT6JipcCxwa0Q8U6uRpP4U19cFEbGkSUzPA1tmUusE4BpJG9WoW/EGcHu+XghMj4g38/Ww
LB8FXA0QEY8BTwPbs+a1vABYkPU/Q7Fk58FM8h0JvLs/hpmZmZmZWV/Uv4U6i4AvV95ExHH51HVO
jbpTgd+XCyJilqSdgdci4m9NZqs3m8r+aoNjrd6wLge2KL0fSi4fqGMCsLmkw/L9xyVtFxFPVI25
Xovj1zKZYjbJlRHxThdm9AMgaT/gVGDviHg9i5dTLNuoGArc16Sro+hYgvFQPoHfFPh7L8e1loh4
qfT2Mjr2Yfhnilk4xwIDgXUkrYqIysahlwJPRMQvSu0r18byTEoMAl6OiABez/H+LOlJigRBrf8D
AG9mG4B3Sm3fyX6h8bVe61oWxXKUTiW9zMzMzMzMelMrT6/vAdaTdEypbECduqOAJ2uUfx/4QQtj
PQZsXfnVAJosZSi5HzgMIDcFbLQh4WxgO0lbSVqHYoZBzWUfkj4JbBARQyJiWEQMA87ONgAvSNox
ZwGMKzV9hWJ/CyJiJbCiNCX/CKo2NoyIZRQ35RfRRZJ2pViaMiYiysmBO4D9JW2SSzj2z7JGlgGj
s98dKRIqL/aBuGr1/7HS2zHAowARcVhEbJnf2XeBqyoJB0k/oUgofKequ6kUMwgADgHuiYhQ8esl
/bLt1sB2wBK6p3zNbk+xJOjxqvKdgeFZfybFppfb5rEB2c7MzMzMzKzPapp0yCe2BwN7S3pK0iyK
KewnZ5U9c8PE+RQ31CfW6OO2yuZ9TcZ6jWJa/O2SZgAvUKyrb+ZHwF6S5lLcvC5rMMZbwLcobnAf
pfiVhkV1qk8Abqwq+z0dSyxOAW6mSMyUN+qbDJyUewBsQ3EjO0nSAmAEHev6y3Fdkvs/VBsgaXnp
r946/kkUT/Svz+9javb7MsUvOMzOvzOzDEnn5b4NlTHOyL5OBI7O7/RaYGLlyb2kpcDPgYnZZqcm
fXU6rloa9H+8ZF+BpAAAIABJREFUip++nA8cD0ys10f2M5QiwbMTMFdr/szmb4HBkhZTLKOozIrY
C1iQY9wAfLNRrC26COgnaSEwheIzfh24GBiY18r3gFkAEfFintu1eWwmxXKkphp8dmZmZmZmZm2l
jlngfYOkgRGxSsUagwsppsCf39txmX2QHHPq2XHb28ObV7QPvKXnfKm3QzAzMzOz3tHSvgDd2hyw
TY7OjfIWUUyBv6SX4zEzMzMzMzOzLmhlI8m2kHQjsFVV8ck5q6HbMxskDabjpxDLRldtPtgsnk7v
M9BOkk4FDq0qvj4izuqNeHqapIeBdauKj4iIhb0RTyN9Lda+Fo+ZmZmZmVmvJR0iYlzzWt3q/yWK
/RNard/WeHpKJhfeFwmGWiJij96OoVV9Lda+Fo+ZmZmZmVlfXF5hZmZmZmZmZu8DvTbTwcz6rl2G
DOLiY71BoJmZmZmZdY9nOpiZmZmZmZlZWzjpYGZmZmZmZmZt4aSDmZmZmZmZmbWFkw5mZmZmZmZm
1hbeSNLM1rLw2ZUMO+WW3g7D+qil53iTUTMzMzNrjWc6mJmZmZmZmVlbOOlgZmZmZmZmZm3hpIOZ
mZmZmZmZtYWTDmZmZmZmZmbWFk46mJmZmZmZmVlbOOlgZmZmZmZmZm3hpIOZmZmZmZmZtYWTDmZm
ZmZmZmbWFi0lHSRtLukaSUsk/VnSQ5LGSdpH0kpJ8yQtkDRN0keyzURJIWl0qZ9xWXZIdwOXNFLS
BXWOLZW0aYO2B0h6XNJiSae0MNZmkt6U9I0WYztY0k4t1LtC0mpJG5bKfpmf0ab5flWLY54g6a/5
Pdwt6ROlY0dKeiL/jiyVnyXpmeoxJG0p6V5Jj2R/B2X54CxfJelXVW3q9dXpuOqcX73+J0p6Ma/B
eZK+luWfyGt1nqRFkr5ZanNffv+VNpVrdl1JU/K6eFjSsFKb4XndL5K0UNJ6jeLtKRnryO7WyXpT
Jf2l56IzMzMzMzNrrGnSQZKAPwL3R8TWEbEbMB4YmlUeiIgRETEcmA0cV2q+EJhQej8emN/doCX1
j4g5EXF8F9r2Ay4EDgR2Aia0kCA4FJjJmufSyMHZdysWA2Mztn8A9gWebbFt2SPAyPwebgDOyz4/
DJwO7AHsDpwuaZNsc1OWVTsNuC4idqX4zi7K8v8Bfgh8t0aben11Ja5a6vUPMCWvwRER8Zssex74
bESMyDFOkfTxUpvDSm3+nmVHASsiYlvgfODcjLU/8J/ANyPiU8A+wJsNYu1zJP0b0FICy8zMzMzM
rKe0MtPh88AbEfHrSkFEPB0R/1GulMmJDYEVpeIHgN0lfUjSQGBbYF6jwSQdJOkxSTMkXSDp5iw/
Q9Klku4ErspZFpVjgyXdmU/mLwHUYIjdgcURsSQi3gAmkzf9DUwATgSGShpSinVV6fUhOXPhs8AY
YFI+Rd9G0ghJM/Np/41VN9fXAl/J1/sADwJvNYlnLRFxb0Sszrcz6UgKfRG4KyJejogVwF3AAdlm
ZkQ8X6s7YKN8PQh4Luu/GhEzKJIP1ePX7KsrcdU5v3qx1qv/RkS8nm/XpbVrfSxwZb6+ARid1/X+
wIKImJ99vxQRb9frJGeCnJszLaZJ2j1nIyyRNCbrrCfp8pw18YikfbN8fUmT81qZAqxf6nf/nG0x
V9L1+X+qqax3AvCTJvW+LmmOpDlvr17ZStdmZmZmZmYNtXIj9ilgboPje0qaBywD9gN+VzoWwDSK
G8yxwNRGA+WU9UuAAyNiFLBZVZXdgLER8dWq8tOBGflkfiqwZYNhhgDPlN4vz7J6MW0BfDQiZgHX
0ZEgqCki/pQxnJRP0Z8ErgJOzqf9CzPeiieAzTIRMYEiCdJdRwG35etOnW86Azhc0nLgVuDbPRBT
T8RVz5fzJv2G/L6A4ruTtCDHOTciniu1uTyTQj/MxMIaMUXEW8BKYDCwPRCS7sgb/u81iWcD4L6c
FfQKxc3+F4BxwJlZ57gcZxeK7/3KvP6PAVbntXIWxTWPiuU2pwH7RcSngTkUiYRW/Bj4GbC6UaWI
uDQiRkbEyH4DBrXYtZmZmZmZWX2d3khS0oWS5kuanUWV5RVbAJeT0+dLJlNM0R9P8VS/kR2AJRHx
VL6vrj81Il6r0W4viunvRMQtrDnbYq1TqFEWDeqPp0g2QHEurS6xKAaTBgEbR8T0LLoy4y37Q46z
B8XskC6TdDgwEphUKapRrdH5QnGOV0TEUOAg4Opc+tHbcdVyEzAsb9Kn0TFTgYh4Jsu3BY6UtHke
Oixv9vfMvyOaxNQfGAUclv+OU2mvkhreAG7P1wuB6RHxZr4eluWjgKszzseApymSG+VreQGwIOt/
hmLJzoOZ5DsSeHd/jHokjQC2jYgbm9U1MzMzMzPraa3cSC4CPl15ExHHAaNZexYCFE/417ihzhkC
OwObRsTfmozVaFkEwKsNjrV6w7oc2KL0fii5fKCOCcBESUspzu8fJW1XY8zubCw4meJp9F0R8U5X
O5G0H3AqMKa0tKCz5wvFjITrACLiIYpzq7sx53sY11pyqUOlz8vImQFVdZ6juI73zPfP5r+vANfQ
sVfEuzHlPg6DgJezfHpE/HcuFbmV0v+JGt6MiMq18Q7weo73DkUCAxpf67WuZVFcH5V9KHaKiKMa
9FHxz8Buef3OALaXdF8L7czMzMzMzLqtlaTDPcB6ko4plQ2oU3cU8GSN8u8DP2hhrMeArUu/GtBw
KUPJ/RRPoZF0INBoQ8LZwHaStpK0DsUMg5rLPiR9EtggIoZExLCIGAacnW0AXpC0Y84CGFdq+grF
/hZExEpghaQ989gRwPRSXSJiGcVN+UV0kaRdKZamjCltjAhwB7C/pE1yCcf+WdbIMorEEpJ2pEg6
vNgH4qrV/8dKb8cAj2b5UEnr5+tNgM8Bj0vqr45fBvkQ8C9A5RcdplLMIAA4BLgnkwd3AMMlDchk
xN7AXzsba5XyNbs9xZKgx6vKdwaGZ/2ZwOckbZvHBmS7hiLi4oj4eF67o4C/RcQ+3YzdzMzMzMys
Jf2bVYiIkHQwcH6uZX+RYsbByVmlsqeDKNbAf61GH7dVl9UZ6zVJxwK3S/pvYFZrp8GPgGslzaW4
oV/WYIy3JH2L4kayH/C7iFhUp/oEoHpa+u/pmJlwCnAzxT4AfwEqG/tNBi6TdDzFzeuRwK8lDQCW
AP+rRlyX1IlhQO6tUPHziPh5jXqTcvzrc4uCZRExJiJelvRjimQLwJkR8TKApPOAr5bG+E1EnEGx
aeZlkv43xVP3iZUn9/nEfCNgnbwu9o+Ivzboq9Nx1dKg/+Nzc8a3KGYlTMwmOwI/kxQU1+ZPI2Kh
pA2AOzLh0I9iScZl2ea3FEtJFmdf4wEiYoWkn2esAdyay3i64yKKa2Jhxj4xIl6XdDHFfhMLKDZd
nZUxvChpIsV1vm72cRrQbPaQmZmZmZlZr1HHLPC+QdLAiFiVm/tdCDwREef3dlxmHyTHnHp23Pb2
8OYV7QNp6Tlf6u0QzMzMzKz3NdseAejCRpLvgaNz5sQiijX19WYAmJmZmZmZmVkf1nR5RbtIuhHY
qqr45JzV0O2ZDZIGA3fXODQ6Il7qRDyd3megnSSdChxaVXx9RJzVG/H0NEkPA+tWFR8REQt7I55G
+lqsfS0eMzMzMzOzXks6RMS45rW61f9LwIhO1G9rPD0lkwvviwRDLRGxR2/H0Kq+Fmtfi8fMzMzM
zKzXkg5m1nftMmQQFx/rdftmZmZmZtY9fXFPBzMzMzMzMzN7H3DSwczMzMzMzMzawkkHMzMzMzMz
M2sLJx3MzMzMzMzMrC28kaSZrWXhsysZdsotvR2GddPSc7wZqJmZmZn1Ls90MDMzMzMzM7O2cNLB
zMzMzMzMzNrCSQczMzMzMzMzawsnHczMzMzMzMysLZx0MDMzMzMzM7O2cNLBzMzMzMzMzNrCSQcz
MzMzMzMzawsnHczMzMzMzMysLVpKOkjaXNI1kpZI+rOkhySNk7SPpJWS5klaIGmapI9km4mSQtLo
Uj/jsuyQ7gYuaaSkC+ocWypp0wZtD5D0uKTFkk5pYazNJL0p6RstxnawpJ1aqHeFpNWSNiyV/TI/
o03z/aoWxzxB0l/ze7hb0idKx46U9ET+HVkqP0vSM9VjSNpS0r2SHsn+DsrywVm+StKvqtrU66vT
cdU5v3r9T5T0Yl6D8yR9rer4RpKercQraYCkWyQ9JmmRpHNKddeVNCWvi4clDcvyYZJeK43x60ax
9iRJ90ka2dU6jc7XzMzMzMys3ZomHSQJ+CNwf0RsHRG7AeOBoVnlgYgYERHDgdnAcaXmC4EJpffj
gfndDVpS/4iYExHHd6FtP+BC4EBgJ2BCCwmCQ4GZrHkujRycfbdiMTA2Y/sHYF/g2Rbblj0CjMzv
4QbgvOzzw8DpwB7A7sDpkjbJNjdlWbXTgOsiYleK7+yiLP8f4IfAd2u0qddXV+KqpV7/AFPyGhwR
Eb+pOvZjYHpV2U8jYgdgV+Bzkg7M8qOAFRGxLXA+cG6pzZOlMb7ZIM6+qN75mpmZmZmZtVUrMx0+
D7wREe8+3Y2IpyPiP8qVMjmxIbCiVPwAsLukD0kaCGwLzGs0mKSD8qnsDEkXSLo5y8+QdKmkO4Gr
cpZF5dhgSXfmk/lLADUYYndgcUQsiYg3gMnkTX8DE4ATgaGShpRiXVV6fUjOXPgsMAaYlE/Ft5E0
QtLMfNp/Y9XN9bXAV/L1PsCDwFtN4llLRNwbEavz7Uw6kkJfBO6KiJcjYgVwF3BAtpkZEc/X6g7Y
KF8PAp7L+q9GxAyK5EP1+DX76kpcdc6vXqx1SdoN2By4s9TP6oi4N1+/AcwtxTQWuDJf3wCMzuu6
U3ImyLkqZgVNk7R7zkZYImlM1llP0uWSFuZ1u2+Wry9pcl4rU4D1S/3ur2KW0VxJ1+f/qYaanG91
3F+XNEfSnLdXr+zsaZuZmZmZma2llaTDpyhuVOrZU9I8YBmwH/C70rEAplHcYI4FpjYaSNJ6wCXA
gRExCtisqspuwNiI+GpV+enAjHwyPxXYssEwQ4BnSu+XZ1m9mLYAPhoRs4Dr6EgQ1BQRf8oYTsqn
4k8CVwEn59P+hRlvxRPAZpmImECRBOmuo4Db8nWnzjedARwuaTlwK/DtHoipJ+Kq58t5k35Dfl+V
WSM/A06q10jSxsC/AndXxxQRbwErgcF5bKtMDkyXtGeTeDYA7stZQa8APwG+AIwDzsw6x+U4u1B8
71fm9X8MsDqvlbMornlULLc5DdgvIj4NzAFOaPrJND7fNUTEpRExMiJG9hswqDNdm5mZmZmZ1dTp
jSQlXShpvqTZWVRZXrEFcDk5fb5kMsUU/fEUT/Ub2QFYEhFP5fvq+lMj4rUa7fYC/hMgIm5hzdkW
a51CjbJoUH88RbIBinNpdYlFMZg0CNg4IipT/K/MeMv+kOPsQTE7pMskHQ6MBCZVimpUa3S+UJzj
FRExFDgIuDpv4ns7rlpuAoblTfo0OmYqHAvcGhHP1GokqT/F9XVBRCxpEtPzwJaZ1DoBuEbSRjXq
VrwB3J6vFwLTI+LNfD0sy0cBVwNExGPA08D2rHktLwAWZP3PUCzZeTCTfEcC7+6P0Uyd8zUzMzMz
M2ur/i3UWQR8ufImIo7Lp65zatSdCvy+XBARsyTtDLwWEX9rMlu92VT2Vxsca/WGdTmwRen9UHL5
QB0TgM0lHZbvPy5pu4h4omrM9Vocv5bJFLNJroyId7owox8ASfsBpwJ7R8TrWbycYtlGxVDgviZd
HUXHEoyH8gn8psDfezmutUTES6W3l9GxD8M/U8zCORYYCKwjaVVEVDYOvRR4IiJ+UWpfuTaW5036
IODliAjg9Rzvz5KepEgQ1Po/APBmtgF4p9T2newXGl/rta5lUSxH6VTSq6TW+ZqZmZmZmbVVK0+v
7wHWk3RMqWxAnbqjgCdrlH8f+EELYz0GbK381QCaLGUouR84DCA3yWu0IeFsYDtJW0lah2KGQc1l
H5I+CWwQEUMiYlhEDAPOzjYAL0jaMWcBjCs1fYVifwsiYiWwojQl/wiqNjaMiGUUN+UX0UWSdqVY
mjImIsrJgTuA/SVtkks49s+yRpYBo7PfHSkSKi/2gbhq9f+x0tsxwKMAEXFYRGyZ39l3gasqCQdJ
P6FIKHynqrupFDMIAA4B7omIUPHrJf2y7dbAdkB3ZwuUr9ntKZYEPV5VvjMwPOvPpNgEcts8NiDb
NdXgfM3MzMzMzNqqadIhn9geDOwt6SlJsyimsJ+cVfbMDRPnU9xQn1ijj9sqm9k1Ges1imnxt0ua
AbxAsa6+mR8Be0maS3HzuqzBGG8B36K4wX2U4lcaFtWpPgG4sars93QssTgFuJkiMVPe5HAycFLu
AbANxY3sJEkLgBF0rOsvx3VJ7v9QbYCk5aW/euv4J1E80b8+v4+p2e/LFL/gMDv/zswyJJ2X+zZU
xjgj+zoRODq/02uBiZUn95KWAj8HJmabnZr01em4amnQ//EqfgpyPnA8MLFeH9nPUIoEz07AXK35
M5u/BQZLWkyxjKIyK2IvYEGOcQPwzUaxtugioJ+khcAUis/4deBiYGBeK98DZgFExIt5btfmsZkU
y5EaanK+ZmZmZmZmbaWOWeB9g6SBEbFKxRqDCymmhJ/f23GZfZAcc+rZcdvbw5tXtD5t6Tlf6u0Q
zMzMzOz9q6V9Abq1OWCbHJ0b5S2imBJ+SS/HY2ZmZmZmZmZd0MpGkm0h6UZgq6rik3NWQ7dnNkga
TO2fBhxdtflgs3g6vc9AO0k6FTi0qvj6iDirN+LpaZIeBtatKj4iIhb2RjyN9LVY+1o8ZmZmZmZm
vZZ0iIhxzWt1q/+XKPZPaLV+W+PpKZlceF8kGGqJiD16O4ZW9bVY+1o8ZmZmZmZmfXF5hZmZmZmZ
mZm9D/TaTAcz67t2GTKIi4/1JoRmZmZmZtY9nulgZmZmZmZmZm3hpIOZmZmZmZmZtYWTDmZmZmZm
ZmbWFk46mJmZmZmZmVlbeCNJM1vLwmdXMuyUW96z8Zae400rzczMzMzejzzTwczMzMzMzMzawkkH
MzMzMzMzM2sLJx3MzMzMzMzMrC2cdDAzMzMzMzOztnDSwczMzMzMzMzawkkHMzMzMzMzM2sLJx3M
zMzMzMzMrC2cdOhBkraQ9JSkD+f7TfL93pJekzRP0l8lXSXpQ5K+mGXzJK2S9Hi+vqrBGN+XtDjr
frGFmMZJCkk7tHgO35E0oIV6SyU9UFU2T9Jf8vU+km5uccz/yvP5i6TfSfpQlkvSBXm+CyR9utTm
dkn/t3oMSaMlzc1YZkjaNsv3yvK3JB1S1aZeX52Oq8751ev/irw+KtfAiKrj/yTp7Uq8kkZIekjS
ohz3K6W6W0l6WNITkqZIWifLJ0p6sTTG15p9H2ZmZmZmZj3FSYceFBHPABcD52TROcClwNPAkxEx
AtgFGAr8fxFxR0SMyPI5wGH5/t9r9S9pJ2A88CngAOAiSf2ahDUBmJHtWvEdoGnSIW0oaYuMbccW
29TyX8AOFJ/N+kDlxvhAYLv8+zrFZ1sxCTiiRl8Xk58jcA1wWpYvAyZmWbV6fXUlrlrq9Q9wUuUa
iIh5lcL8Xs8F7ijVXQ38e0RUvv9fSNo4j50LnB8R2wErgKNK7aaUxvhNk1jNzMzMzMx6jJMOPe98
4DOSvgOMAn5WPhgRbwOzgCFd6HssMDkiXo+Ip4DFwO71KksaCHyO4gZ0fKl8jVkIkn6VT8SPBz4O
3Cvp3jw2QdLCfNp/btUQ1wGVp+0TgGu7cE5ExK2RKD6boaXzvSoPzQQ2lvSxbHM38Eqt7oCN8vUg
4LmsvzQiFgDv1Bi/Zl9diavO+dWLtZFvA78H/l7q528R8US+fi6PbSZJwOeBG7LqlcDBnRwPSV+X
NEfSnLdXr+xsczMzMzMzs7U46dDDIuJN4CSK5MN3IuKN8nFJ6wF7ALd3ofshwDOl98tpnLw4GLg9
Iv4GvNxsGUBEXEBxk75vROwr6eMUT9A/D4wA/klS+Wb2BuDf8vW/Ajd15mSq5fKFI+j4bDp7vlDM
RrhV0vLs65wm9d+ruOo5K5dKnC9p3RxvCDAO+HWDmHYH1gGeBAYD/zci3qoTz5dzjBsqM1NqiYhL
I2JkRIzsN2BQF0/HzMzMzMysg5MO7XEg8Dywc6lsG0nzgJeAZfnUvbNUoywa1J8ATM7Xk/N9Z/wT
cF9EvJg3tP8F7FU6/jKwQtJ44FGK6f/dcRFwf0RU9oro7PkC/G/goIgYClwO/LybMfVUXLV8n2L5
xj8BHwZOzvJfACfnrJi15KyKq4H/FRHvNInnJmBYRAwHplHMgjAzMzMzM3tP9O/tAN5vcjPALwCf
AWZIqtz0PxkRI/KG8T5JYyJiaie7Xw6Un1QPJZcP1IhjMMUMhZ0lBdAPCEnfA95izYTTevVOp4WY
pgAXUuyX0GWSTgc2A75RKm75fLOPzYB/jIiHS7F1ZUZJj8ZVT0Q8ny9fl3Q58N18PxKYXKyaYFPg
IElvRcQfJW0E3AKclks7AP6bYolH/0wOvRtPRLxUGvIyipkrZmZmZmZm7wnPdOhBubb+YoplFcso
NhD8ablO3mieQvGUu7OmAuMlrStpK4qNDGfVqXsIxb4Dn4iIYRGxBfAUxT4TTwM7ZT+DgNGldq8A
G+brh4G9JW2aGxtOAKZXjXMjcB5rbnjYKfmLCl8EJuST+/L5/nv+WsRngJWlG/VaVgCDJG2f779A
MQOjt+Oq1//H8l9RLIX5C0BEbJXf2TCKJSzHZsJhHYrP+6qIuL7ST+45cS/Fdw5wJPB/ymOkMXTj
8zAzMzMzM+ssJx161tEUSyfuyvcX8f+zd6dhd1Xl/ce/PwkQZjBBigQMMhSZmkgYKoMMMlaBFJBE
CoQ/SiVQqlQL1AGrcslgxaKEUZkqhMGCYRYwDLEEiCEDYZAQAgSoEEEkMobc/xfrPmTncKbnyXNI
rL/PdT1Xzll7Dfc+Z+fFvvda65Tp8x+pq3cdsKKkHXvSeUTMoGze+DDlCf4xzabgUxIE19aV/Rz4
XP7KxlXANMqSiQcrdc4HbpY0Pm+kT6Lc0E4FJkfEL+piejUiTqvfuyLtJmlO5e9vm8R6LrAWcG/+
rOM3s/wmYBZlw8wLgNG1Bio/13l1ZYw98yn/F4CfS5pK2Yfhq1l/69zn4SDgPEkzWvXV27gaadH/
zyRNB6ZTZjR8t1U/wGcpy1tG6b0/s3kCcLykmZQ9Hn6S5cflT2xOBY5jMWekmJmZmZmZ9YTKQ1Iz
s4WO/tr34uZ3tnzfxpt96t+9b2OZmZmZmVmf6GQ5vmc6mJmZmZmZmVl3eCPJpVBOv6/f8O/JiBje
oO4A4I4G3exWt4ngEifpWmD9uuITIqLX+0EsLSRtQflFiao3I2LbJRGPmZmZmZnZ0sBJh6VQ3oR3
dCOeiYUhbSsuBRolTf6viIjp/Jl8D2ZmZmZmZu8XL68wMzMzMzMzs67wTAcze48t1lmNc0Z7c0cz
MzMzM1s8nulgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFU46mJmZmZmZmVlXOOlgZmZm
ZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFU46mJmZmZmZmVlXOOlgZmZmZmZmZl3hpIOZmZmZ
mZmZdYWTDmZmZmZmZmbWFU46mJmZmZmZmVlXdJx0kLSWpMslzZL0G0n3ShouaWdJNzSof6ekpyWp
UnadpHl9Ebikb0v6VIPyhvFUjkvSWZJmSpom6eMdjPVlSW9IWq3D2P6tw3oh6bLK+36SXqzFL2mU
pB930M+Kkm6U9KikGZJOrRxbXtKVeb73SRqc5QMkjZc0r34MSSMlTc/P5xZJA7P8oOx/gaRhlfoN
++pNXE3Or1Wsd0p6TNKU/PtQ3fED83Melu93z+t3ev67a6XuVlk+M68RZfm3JD1bGWOfdt9JX5A0
WNJDfVDnpDynxyTt2bdRmpmZmZmZNddR0iFvvq4D7o6Ij0bEVsAIYFCbpn8Ats8+VgfWXoxYq/Es
ExHfjIjbe9F8b2Cj/DsKOKeDNiOBB4DhHY7RUdIB+BOwuaQV8v3uwLMdtq33/YjYBBgKbC9p7yw/
Eng5IjYEzgROy/I3gG8AX6l2Iqkf8J/ALhGxJTANODYPPwT8PXB33dgN++plXI206h/gkIgYkn8v
VM5lFeA44L5K3bnAZyJiC+Bw4LLKsXMo10Tt+tircuzMyhg3tYh1qSJpU8r/1c0o5zNG0jJLNioz
MzMzM/tL0elMh12BtyLi3FpBRDwVET9q024s5YYHys3qf7eqLOkDksbkU/EbJN0k6cA8NlvSNyVN
AA6SdHHl2F75NH1CjtPKfsClUUwEVpfUNBkiaQNgZeDrlORDrXyRWQgZ7875NH+FfCL+szx2vKSH
8u9LdUPcDPxdvh4JXNEm/veIiNciYny+fguYzMKE0H7AJfn6GmA3SYqIP0XEBMoN/SKnnH8rZbJp
VeC57PuRiHiswfgN++pNXE3Or1ms7XwHOL3aLiIejIjn8u0MoH/OulgbWDUi7o2IAC4F9u/heLXr
4jpJ10t6UtKx+f0/KGmipA9mvSH5fpqkayWtkeVbSZoq6V7gmEq/y0g6Q9ID2eYfOwxpP2BsRLwZ
EU8CM4FtenpeZmZmZmZmvdFp0mEzyg1jT90B7JRPVkcAV7ap//fAYGAL4PPA39YdfyMidoiIsbUC
Sf2BC4DPADsCf9VmjHWAZyrv52RZM7VEwD3AX9dP368XEScCr+cT8UMkbQUcAWwLbAd8QdLQSpOx
wIg8jy1Z9Kl8j+WMks9QPnuonG9EzAdeAQa0iP9t4GhgOiXZsCnwk8WJqS/iauOiTPJ8o7IkYiiw
bkQ0XWoDHAA8GBFvZjxzKsfqr4tj82b/p7UEQQubA5+j3NyfArwWEUOBe4HDss6lwAk5m2Q6cHLt
XIDjIqJlYIjvAAAgAElEQVT+2j8SeCUitga2plxH67eJA3pwvUs6StIkSZPmzp3bQddmZmZmZmat
9WojSUln59PYB9pUfQeYABwMrBARs9vU3wG4OiIWRMT/AuPrjjdKWmwCPBkRj+cT6v9qF36DsmhR
fwTlSfECykyNg9r0X28H4Np8Wj8v+9jx3YEjplESLSOBxZq2n0sjrgDOiohZteIGVZuer6RlKUmH
ocCHKcsrTlrScbVwSC6V2DH/DpX0AcqSjX9pEdNmlCUdtRkDreI5B9gAGAI8D/xHm5jGR8SrEfEi
JZlyfZZPBwar7A2yekTcleWXUJJz9eXVpR97AIdJmkJJTA2gLAFpp+PPOSLOj4hhETFs4MCBHXRt
ZmZmZmbWWqdJhxnAuxsuRsQxwG7Amh20HQv8CLiqg7oNp9dX/KlJeU9uVucA61beDyKXD7wnGGlL
yo3dbZJmUxIQtSUW81n08+vfZLx25wQwDvg+vVhaUed84PGI+GGl7N3zzZv/1YCXWvQxBCAinsgk
zlXAJ5aCuBqKiGfz31eByymzC1ahzDa4M7+37YBxWriZ5CDgWuCwiHiiEk91j5J3r4uI+F1EvJOJ
pwtovzzhzcrrBZX3C4B+LdqJ5teygH+q7CuxfkT8sk0c0IPr3czMzMzMrK91mnT4FWXt+9GVshU7
bHsP8D06u6GeAByQezusBezcQZtHgfVz7wWo7LvQxDjKE2NJ2o4yZf35JnVHAt+KiMH592FgHUkf
AWYDQzLWdVn0RvTtnDEAZdPF/VV+yWElymaU99SN81Pg2xExvYPzbUjSdyk37vV7RoyjbJgIcCDw
q0wmNPMssKmkWkJpd+CRpSCuRn3308Jf1lgW+DTwUES8EhEDa98bMBHYNyIm5TKPG4GTIuLXtb7y
GnhV0na5ROMw4BfZd3XPj+GUDTV7LSJeAV6WVJvxcihwV0T8AXhF0g5Zfkil2a3A0bXrStLGeT21
M46yfGf5XI6xEXD/4sRvZmZmZmbWqVZPXd8VESFpf+BMSf8KvEiZdXBCVtlNUnU9/EHVtpSn+J34
OWUGxUPAbynTyF9pE9sbko4CbpQ0l5K42LxFk5uAfSgb6r1G2W+hmRGUX7uoujbLTweepEyZf4hF
97w4H5gmaXLu63AxC2/0LoyIB+vOYQ7lFyMaGZWffc12Wf9d+eT+a5QEzOTc1uDHEXEhZT+GyyTN
pMwkGFFpN5uyUeRyOcYeEfGwpH8H7pb0NvAUMCrrD6fMWlmT8nlPiYg9m/UF/LE3cTXSpP+ngFvz
RnwZ4HbKTIRWjgU2BL4h6RtZtkf+6sXRwMXACpQNPm/O46dLGkKZhTCbhUsyFsfhwLmSVgRmsfA6
PAL4qaTXKImGmgspy3AmZ1LkRTrY6DIiZki6CniYMjvnmIh4pw/iNzMzMzMza0s9fLjcdZJWjoh5
kgZQbtS3z/0dzOx9MmbMmBg9evSSDsPMzMzMzJZenWwl0NlMh/fZDTkFfjngO044mJmZmZmZmf15
WiJJB0lbsOjO/ABvRsS2EbFzH41xBPDPdcW/zk0wO46nL2LpS5LuA5avKz50cfaDWFpI2pPyixJV
T0bE8CURTytLW6xLWzxmZmZmZmawFC6vMLMlz8srzMzMzMysjY6WV3T66xVmZmZmZmZmZj3ipIOZ
mZmZmZmZdYWTDmZmZmZmZmbWFU46mJmZmZmZmVlXOOlgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZm
ZmZmZmbWFU46mJmZmZmZmVlXOOlgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFU46mJmZ
mZmZmVlXOOlgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFR0nHSStJelySbMk/UbSvZKG
S9pZ0g0N6t8p6WlJqpRdJ2leXwQu6duSPtWgvGE8leOSdJakmZKmSfp4B2N9WdIbklbrMLZ/67Be
SLqs8r6fpBdr8UsaJenHHfSzoqQbJT0qaYakUyvHlpd0ZZ7vfZIGZ/kASeMlzasfQ9JISdPz87lF
0sAsPyj7XyBpWKV+w756E1eT82sV652SHpM0Jf8+lOVfzHOYImmCpE2zfLCk1yv1z630tVW2mZnX
SPXa/accZ4ak09t9J30hY32oD+qclOf0mKQ9+zZKMzMzMzOz5jpKOuTN13XA3RHx0YjYChgBDGrT
9A/A9tnH6sDaixFrNZ5lIuKbEXF7L5rvDWyUf0cB53TQZiTwADC8wzE6SjoAfwI2l7RCvt8deLbD
tvW+HxGbAEOB7SXtneVHAi9HxIbAmcBpWf4G8A3gK9VOJPUD/hPYJSK2BKYBx+bhh4C/B+6uG7th
X72Mq5FW/QMcEhFD8u+FLLs8IraIiCHA6cAPKvWfqNT/YqX8HMo1Ubs+9gKQtAuwH7BlRGwGfL9F
rEuVTLaMADajnM8YScss2ajMzMzMzOwvRaczHXYF3oqId58KR8RTEfGjNu3GUm54oNys/nerypI+
IGlMPk2+QdJNkg7MY7MlfVPSBOAgSRdXju2VT9Mn5Dit7AdcGsVEYHVJTZMhkjYAVga+Tkk+1MoX
mYWQ8e6cT/NXyKfoP8tjx0t6KP++VDfEzcDf5euRwBVt4n+PiHgtIsbn67eAySxMCO0HXJKvrwF2
k6SI+FNETKDc0C9yyvm3UiabVgWey74fiYjHGozfsK/exNXk/JrF2lRE/LHydiUgWtXPa2DViLg3
IgK4FNg/Dx8NnBoRb2bfLzTppnZdXCfpeklPSjo2v/8HJU2U9MGsNyTfT5N0raQ1snwrSVMl3Qsc
U+l3GUlnSHog2/xjhx/FfsDYiHgzIp4EZgLbNIn9KEmTJE2aO3duh92bmZmZmZk112nSYTPKDWNP
3QHslE9WRwBXtqn/98BgYAvg88Df1h1/IyJ2iIixtQJJ/YELgM8AOwJ/1WaMdYBnKu/nZFkztUTA
PcBf16bvNxMRJwKv51P0QyRtBRwBbAtsB3xB0tBKk7HAiDyPLYH72sTfUs4o+Qzls4fK+UbEfOAV
YECL+N+m3GRPpyQbNgV+sjgx9UVcbVyUSZ5v1C2JOEbSE5SZDsdV6q+fSYC7JO1YiWdOpU71utgY
2FFlGchdkrZuE8/mwOcoN/enAK9FxFDgXuCwrHMpcELOJpkOnFw7F+C4iKi/9o8EXomIrYGtKdfR
+m3iqJ1XR9d7RJwfEcMiYtjAgQM76NrMzMzMzKy1Xm0kKensfBr7QJuq7wATgIOBFSJidpv6OwBX
R8SCiPhfYHzd8UZJi02AJyPi8XxC/V/twm9Q1uop+AjKk+IFlJkaB7Xpv94OwLX5tH5e9lG70SUi
plESLSOBm3rY9yJyacQVwFkRMatW3KBq0/OVtCwl6TAU+DBlecVJSzquFg6JiC0on+mOwKHvdhZx
dkRsAJxAmakC8DywXiYBjgcul7Rqm3j6AWtQkkZfBa5qNisjjY+IVyPiRUoy5fosnw4MVtkbZPWI
uCvLL6Ek5+rLL6v0uQdwmKQplMTUAMoSkHb66nM2MzMzMzPrsU6TDjOAdzdcjIhjgN2ANTtoOxb4
EXBVB3Vb3chB2QOhkZ7cRM0B1q28H0QuH3hPMNKWlBu72yTNpiQgakss5rPo59e/yXjtzglgHGWf
gB4vrahzPvB4RPywUvbu+ebN/2rASy36GAIQEU9kEucq4BNLQVwNRcSz+e+rwOU0XjowllwqkcsM
fp+vfwM8QZnJMIdF9yipXhdzgP/OJTn3AwuAVlMB3qy8XlB5v4CSwGhGNL+WBfxTZS+K9SPily36
qun4ejczMzMzM+trnSYdfgX0l3R0pWzFDtveA3yPzm6oJwAH5N4OawE7d9DmUcp0+Q3y/chWlSk3
+Iep2I4yZf35JnVHAt+KiMH592FgHUkfAWYDQzLWdVn0ZvftnDEAZdPF/VV+yWElymaU99SN81Pg
2xExvYPzbUjSdyk37vV7RowDDs/XBwK/ymRCM88Cm0qqJZR2Bx5ZCuJq1Hc/LfxljWWBT1M2u0RS
dRbA3wGPZ/matY0UJX2UklSaldfAq5K2y1kMhwG/yPbXUfY1QdLGwHJArzc9iIhXgJcrSzsOBe6K
iD8Ar0jaIcsPqTS7FTi6dl1J2jivp3bGUZbvLJ/LMTYC7u9t7GZmZmZmZj3R6qnruyIiJO0PnCnp
X4EXKbMOTsgqu0mqroc/qNqWznf7/zllBsVDwG8p08hfaRPbG5KOAm6UNJeSuNi8RZObgH0oG+q9
RtlvoZkRlF+7qLo2y08HnqRMmX+IRfe8OB+YJmly7utwMQtv9C6MiAfrzmEO5RcjGhmVn33Ndln/
XZIGAV+jJGAm58z/H0fEhZT9GC6TNJMyk2BEpd1sykaRy+UYe0TEw5L+Hbhb0tvAU8CorD+cMmtl
TcrnPSUi9mzWF/DH3sTVSJP+nwJuzRvxZYDbKft7AByr8pOqbwMvszDBsRPwbUnzKct/vhgRtRkW
RwMXAytQNvi8Oct/CvxU5acp3wIO72mCpIHDgXMlrQjMYuF1eESO9Rol0VBzIWUZzuRMirzIwo0u
m4qIGZKuAh6mzM45JiLeWczYzczMzMzMOqLFv3fqW5JWjoh5kgZQbtS3z/0dzOx9MmbMmBg9evSS
DsPMzMzMzJZenWwl0NlMh/fZDflLB8sB33HCwczMzMzMzOzP0xJJOkjagkV35gd4MyK2jYid+2iM
I4B/riv+dW6C2XE8fRFLX5J0H7B8XfGhi7MfxNJC0p7AaXXFT0bE8CURTytLW6xLWzxmZmZmZmaw
FC6vMLMlz8srzMzMzMysjY6WV3T66xVmZmZmZmZmZj3ipIOZmZmZmZmZdYWTDmZmZmZmZmbWFU46
mJmZmZmZmVlXOOlgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFU46mJmZmZmZmVlXOOlg
ZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFU46mJmZmZmZmVlXOOlgZmZmZmZmZl3hpIOZ
mZmZmZmZdUVHSQdJa0m6XNIsSb+RdK+k4ZJ2lvSKpCmSpkm6XdKHss0oSSFpt0o/w7PswMUNXNIw
SWc1OTZb0sAWbfeS9JikmZJO7GCsNSW9LekfO4xtf0mbdlDvYkmvSVqlUvaf+RkNzPfzOhzzeEkP
5/dwh6SPVI4dLunx/Du8Un6KpGfqx5C0nqTxkh7M/vbJ8gFZPk/Sj+vaNOurx3E1Ob9m/Y+S9GJe
g1MkfT7LP5LX6hRJMyR9sdLmzvz+a21q1+zykq7M6+I+SYMrbbbM636GpOmS+reKt69krMMWp46k
WyRNzdjPlbRM30dqZmZmZmb2Xm2TDpIEXAfcHREfjYitgBHAoKxyT0QMiYgtgQeAYyrNpwMjK+9H
AFMXN2hJ/SJiUkQc14u2ywBnA3sDmwIjO0gQHARMZNFzaWX/7LsTM4H9MrYPALsAz3bYtupBYFh+
D9cAp2efHwROBrYFtgFOlrRGtrk+y+p9HbgqIoZSvrMxWf4G8A3gKw3aNOurN3E10qx/gCvzGhwS
ERdm2fPAJyJiSI5xoqQPV9ocUmnzQpYdCbwcERsCZwKnZaz9gP8CvhgRmwE7A2+3iHVp89mI+Btg
c2BNyvVsZmZmZmbWdZ3MdNgVeCsizq0VRMRTEfGjaqVMTqwCvFwpvgfYRtKyklYGNgSmtBpM0j6S
HpU0QdJZkm7I8m9JOl/SL4FLc5ZF7dgASb/MJ/PnAWoxxDbAzIiYFRFvAWPJm/4WRgL/AgyStE4l
1nmV1wfmzIVPAPsCZ+RT9A0kDZE0MZ/2X1t3c30FcHC+3hn4NTC/TTzvERHjI+K1fDuRhUmhPYHb
IuKliHgZuA3YK9tMjIjnG3UHrJqvVwOey/p/iogJlORD/fgN++pNXE3Or1mszeq/FRFv5tvl6exa
3w+4JF9fA+yW1/UewLSImJp9/z4i3mnWSc4EOS1nWtwuaZucjTBL0r5Zp7+ki3LWxIOSdsnyFSSN
zWvlSmCFSr975GyLyZKuzv9TnXwWf8yX/YDlKN9vo7iPkjRJ0qS5c+d20rWZmZmZmVlLndyIbQZM
bnF8R0lTgKeBTwE/rRwL4HbKDeZ+wLhWA+WU9fOAvSNiB8pT2aqtgP0i4nN15ScDE/LJ/DhgvRbD
rAM8U3k/J8uaxbQu8FcRcT9wFQsTBA1FxP9kDF/Np+hPAJcCJ+TT/ukZb83jwJqZiBhJSYIsriOB
m/N1j843fQv4B0lzgJuAf+qDmPoirmYOyJv0a/L7Asp3J2lajnNaRDxXaXNRJoW+kYmFRWKKiPnA
K8AAYGMgJN2aN/z/2iaelYA7c1bQq8B3gd2B4cC3s84xOc4WlO/9krz+jwZey2vlFMo1j8pym68D
n4qIjwOTgOM7/YAk3Qq8kPFc06hORJwfEcMiYtjAgU1XJ5mZmZmZmXWsxxtJSjo714c/kEW15RXr
AheR0+crxlKm6I+gPNVvZRNgVkQ8me/r64+LiNcbtNuJMv2diLiRRWdbvOcUGpQ1fPKbRlCSDVDO
pdMlFmUwaTVg9Yi4K4suyXir/jvH2ZYyO6TXJP0DMAw4o1bUoFqr84VyjhdHxCBgH+CyXPqxpONq
5HpgcN6k387CmQpExDNZviFwuKS18tAhebO/Y/4d2iamfsAOwCH573BV9ipp4C3glnw9HbgrIt7O
14OzfAfgsozzUeApSnKjei1PA6Zl/e0oS3Z+nUm+w4F398doJyL2BNamzPrYtdN2ZmZmZmZmi6OT
G8kZwMdrbyLiGGA33jsLAcoT/kVuqHOGwObAwIj4bZuxWi2LAPhTi2Od3rDOAdatvB9ELh9oYiQw
StJsyvn9jaSNGoy5OBsLjgW+Q1lusKC3nUj6FPA1YN/K0oKeni+UGQlXAUTEvZRz6/Wj7z6M6z1y
qUOtzwvImQF1dZ6jXMc75vtn899XgctZuFfEuzHlPg6rAS9l+V0RMTeXitxE5f9EA29HRO3aWAC8
meMtoCQwoPW13uhaFuX6qO1DsWlEHNmij/d2GvEG5Rput5zIzMzMzMysT3SSdPgV0F/S0ZWyFZvU
3QF4okH5ScC/dTDWo8BHK78a0HIpQ8XdlKfQSNobaLUh4QPARpLWl7QcZYZBw2Ufkv4aWCki1omI
wRExGPhetgH4naSP5SyA4ZWmr1L2tyAiXgFelrRjHjsUuKtSl4h4mnJTPoZekjSUsjRl38rGiAC3
AntIWiOXcOyRZa08TUksIeljlKTDi0tBXI36X7vydl/gkSwfJGmFfL0GsD3wmKR+WvjLIMsCnwYe
yvbjKDMIAA4EfpXJg1uBLSWtmMmITwIP9zTWOtVrdmPKkqDH6so3B7bM+hOB7SVtmMdWzHYtSVq5
9hll7PtQ/p+ZmZmZmZl1Xb92FSIiJO0PnJlr2V+kzDg4IavU9nQQZQ385xv0cXN9WZOxXpc0GrhF
0lzg/s5Og38HrpA0mXJD/3SLMeZLOpZyI7kM8NOImNGk+kjg2rqyn7NwZsKJwA2UfQAeAmob+40F
LpB0HOXm9XDgXEkrArOAIxrEdV6TGFbMvRVqfhARP2hQ74wc/+rcouDpiNg3Il6S9B1KsgXg2xHx
EoCk04HPVca4MCK+Rdk08wJJX6Y8dR9Ve3KfMz5WBZbL62KPiHi4RV89jquRFv0fl5szzqfMShiV
TT4G/IekoFyb34+I6ZJWAm7NhMMylCUZF2Sbn1CWkszMvkYARMTLkn6QsQZwUy7jWRxjKNfE9Ix9
VES8Kekcyn4T0yibrt6fMbwoaRTlOl8++/g60G720ErAuGyzDCWJeG7rJmZmZmZmZn1DC2eBLx0k
rRwR83Jzv7OBxyPizCUdl9lfkjFjxsTo0aOXdBhmZmZmZrb0arc9AtCLjSTfB1/ImRMzKGvqm80A
MDMzMzMzM7OlWNvlFd0i6Vpg/briE3JWw2LPbJA0ALijwaHdIuL3PYinx/sMdJOkrwEH1RVfHRGn
LIl4+pqk+yi/sFB1aERMXxLxtLK0xbq0xWNmZmZmZrbULa8wsyXPyyvMzMzMzKyNP9vlFWZmZmZm
Zmb2f4CTDmZmZmZmZmbWFU46mJmZmZmZmVlXOOlgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZm
ZmbWFU46mJmZmZmZmVlXOOlgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFU46mJmZmZmZ
mVlXOOlgZmZmZmZmZl3hpIOZmZmZmZmZdYWTDmZmZmZmZmbWFR0lHSStJelySbMk/UbSvZKGS9pZ
0iuSpkiaJul2SR/KNqMkhaTdKv0Mz7IDFzdwScMkndXk2GxJA1u03UvSY5JmSjqxg7HWlPS2pH/s
MLb9JW3aQb2LJb0maZVK2X/mZzQw38/rcMzjJT2c38Mdkj5SOXa4pMfz7/BK+SmSnqkfQ9J6ksZL
ejD72yfLB2T5PEk/rmvTrK8ex9Xk/Jr1P0rSi3kNTpH0+brjq0p6thavpBUl3SjpUUkzJJ1aqbu8
pCvzurhP0uAsHyzp9coY57aKtS9JulPSsMWpI+kWSVPzfM+VtEzfR2pmZmZmZvZebZMOkgRcB9wd
ER+NiK2AEcCgrHJPRAyJiC2BB4BjKs2nAyMr70cAUxc3aEn9ImJSRBzXi7bLAGcDewObAiM7SBAc
BExk0XNpZf/suxMzgf0ytg8AuwDPdti26kFgWH4P1wCnZ58fBE4GtgW2AU6WtEa2uT7L6n0duCoi
hlK+szFZ/gbwDeArDdo066s3cTXSrH+AK/MaHBIRF9Yd+w5wV13Z9yNiE2AosL2kvbP8SODliNgQ
OBM4rdLmicoYX2wR59LosxHxN8DmwJqU69nMzMzMzKzrOpnpsCvwVkS8+3Q3Ip6KiB9VK2VyYhXg
5UrxPcA2kpaVtDKwITCl1WCS9smn0BMknSXphiz/lqTzJf0SuDRnWdSODZD0y3wyfx6gFkNsA8yM
iFkR8RYwlrzpb2Ek8C/AIEnrVGKdV3l9YM5c+ASwL3BGPhXfQNIQSRPzaf+1dTfXVwAH5+udgV8D
89vE8x4RMT4iXsu3E1mYFNoTuC0iXoqIl4HbgL2yzcSIeL5Rd8Cq+Xo14Lms/6eImEBJPtSP37Cv
3sTV5PyaxdqUpK2AtYBfVvp5LSLG5+u3gMmVmPYDLsnX1wC75XXdIzkT5DSVWUG3S9omZyPMkrRv
1ukv6SJJ0/O63SXLV5A0Nq+VK4EVKv3uoTLLaLKkq/P/VFsR8cd82Q9YjvL9Nor7KEmTJE2aO3du
T0/bzMzMzMzsPTpJOmxGuTFrZkdJU4CngU8BP60cC+B2yg3mfsC4VgNJ6g+cB+wdETtQnspWbQXs
FxGfqys/GZiQT+bHAeu1GGYd4JnK+zlZ1iymdYG/ioj7gatYmCBoKCL+J2P4aj4VfwK4FDghn/ZP
z3hrHgfWzETESEoSZHEdCdycr3t0vulbwD9ImgPcBPxTH8TUF3E1c0DepF+T31dt1sh/AF9t1kjS
6sBngDvqY4qI+cArwIA8tn4mB+6StGObeFYC7sxZQa8C3wV2B4YD3846x+Q4W1C+90vy+j8aeC2v
lVMo1zwqy22+DnwqIj4OTAKOb/vJLDzXW4EXMp5rGtWJiPMjYlhEDBs4sOnqJDMzMzMzs471eCNJ
SWfn+vAHsqi2vGJd4CJy+nzFWMoU/RGUp/qtbALMiogn8319/XER8XqDdjsB/wUQETey6GyL95xC
g7KGT37TCEqyAcq5dLrEogwmrQasHhG1Kf6XZLxV/53jbEuZHdJrkv4BGAacUStqUK3V+UI5x4sj
YhCwD3BZ3sQv6bgauR4YnDfpt7NwpsJo4KaIeKZRI0n9KNfXWRExq01MzwPrZVLreOBySas2qFvz
FnBLvp4O3BURb+frwVm+A3AZQEQ8CjwFbMyi1/I0YFrW346yZOfXmeQ7HHh3f4x2ImJPYG1gecrs
JTMzMzMzs67r10GdGcABtTcRcUw+dZ3UoO444OfVgoi4X9LmwOsR8ds2s9XbTWX/U4tjnd6wzgHW
rbwfRC4faGIksJakQ/L9hyVtFBGP143Zv8PxGxlLmU1ySUQs6MWMfgAkfQr4GvDJiHgzi+dQlm3U
DALubNPVkSxcgnFvPoEfSHlSviTjeo+I+H3l7QUs3IfhbymzcEYDKwPLSZoXEbWNQ88HHo+IH1ba
166NOZmUWA14KSICeDPH+42kJygJgkb/BwDezjYACyptF2S/0Ppab3Qti7IcpUdJr0U6jXhD0jjK
rKPbetuPmZmZmZlZpzp5ev0roL+koytlKzapuwPwRIPyk4B/62CsR4GPKn81gDZLGSruBg4ByE0B
W21I+ACwkaT1JS1HmWHQcNmHpL8GVoqIdSJicEQMBr6XbQB+J+ljOQtgeKXpq5T9LYiIV4CXK1Py
D6VuY8OIeJpyUz6GXpI0lLI0Zd+IqCYHbgX2kLRGLuHYI8taeRrYLfv9GCWh8uJSEFej/teuvN0X
eAQgIg6JiPXyO/sKcGkt4SDpu5SEwpfquhtHmUEAcCDwq4gIlV8vWSbbfhTYCJjF4qlesxtTlgQ9
Vle+ObBl1p9I2fRywzy2YrZrSdLKtc8oEx77UP6fmZmZmZmZdV3bpEM+sd0f+KSkJyXdT5nCfkJW
2TE3TJxKuaH+lwZ93FzbvK/NWK9TpsXfImkC8DvKuvp2/h3YSdJkys3r0y3GmA8cS7nBfYTyKw0z
mlQfCVxbV/ZzFi6xOBG4gZKYqW5yOBb4au4BsAHlRvYMSdOAISxc11+N67zc/6HeipLmVP6areM/
g/JE/+r8PsZlvy9RfsHhgfz7dpYh6fTct6E2xreyr38BvpDf6RXAqNqTe0mzgR8Ao7LNpm366nFc
jbTo/ziVn4KcChwHjGrWR/YziJLg2RSYrEV/ZvMnwABJMynLKGqzInYCpuUY1wBfbBVrh8YAy0ia
DiIWfQUAACAASURBVFxJ+YzfBM4BVs5r5V+B+wEi4sU8tyvy2ETKcqR2VgLGZZuplNkq79tPfpqZ
mZmZ2V82LZwFvnSQtHJEzFNZY3A2ZQr8mUs6LrO/JGPGjInRo0cv6TDMzMzMzGzp1dG+AIu1OWCX
fCE3yptBmQJ/3hKOx8zMzMzMzMx6oZONJLtC0rXA+nXFJ+SshsWe2SBpAAt/CrFqt7rNB9vF0+N9
BrpJ0teAg+qKr46IU5ZEPH1N0n2UX1ioOjQipi+JeFpZ2mJd2uIxMzMzMzNb6pZXmNmS5+UVZmZm
ZmbWxp/t8gozMzMzMzMz+z/ASQczMzMzMzMz6wonHczMzMzMzMysK5x0MDMzMzMzM7OucNLBzMzM
zMzMzLrCSQczMzMzMzMz6wonHczMzMzMzMysK5x0MDMzMzMzM7OucNLBzMzMzMzMzLrCSQczMzMz
MzMz6wonHczMzMzMzMysK5x0MDMzMzMzM7OucNLBzMzMzMzMzLrCSQczMzMzMzMz6wonHczMzMzM
zMysK5x06EOS1pX0pKQP5vs18v0nJb0uaYqkhyVdKmlZSXtm2RRJ8yQ9lq8vbTHGSZJmZt09O4hp
uKSQtEmH5/AlSSt2UG+2pHvqyqZIeihf7yzphg7H/Fmez0OSfipp2SyXpLPyfKdJ+nilzS2S/lA/
hqTdJE3OWCZI2jDLd8ry+ZIOrGvTrK8ex9Xk/Jr1f3FeH7VrYEiW75f9TpE0SdIOlTbvVOqPq5Sv
L+k+SY9LulLScpVjn83rboaky9t9H2ZmZmZmZn3FSYc+FBHPAOcAp2bRqcD5wFPAExExBNgCGAR8
NiJujYghWT4JOCTfH9aof0mbAiOAzYC9gDGSlmkT1khgQrbrxJeAtkmHtIqkdTO2j3XYppGfAZtQ
PpsVgM9n+d7ARvl3FOWzrTkDOLRBX+eQnyNwOfD1LH8aGJVl9Zr11Zu4GmnWP8BXa9dAREzJsjuA
v8lz+H/AhZX6r1fq71spPw04MyI2Al4GjgSQtBFwErB9RGxG+X7NzMzMzMzeF0469L0zge0kfQnY
AfiP6sGIeAe4H1inF33vB4yNiDcj4klgJrBNs8qSVga2p9yAjqiULzILQdKPJY2SdBzwYWC8pPF5
bKSk6fm0/7S6Ia4CDs7XI4ErenFORMRNkSifzaDK+V6ahyYCq0taO9vcAbzaqDtg1Xy9GvBc1p8d
EdOABQ3Gb9hXb+Jqcn7NYm1Wf16OCbBSnlNTkgTsClyTRZcA++frLwBnR8TL2fcLLfo5KmdWTJo7
d26n4ZqZmZmZmTXlpEMfi4i3ga9Skg9fioi3qscl9Qe2BW7pRffrAM9U3s+hdfJif+CWiPgt8FK7
ZQARcRblJn2XiNhF0ocpT9B3BYYAW0vav9LkGuDv8/VngOt7cjL1cvnCoSz8bHp6vlBmI9wkaU72
dWqb+u9XXM2ckkspzpS0fGXM4ZIeBW6kzHao6Z+JgYmV72IA8IeImN8gno2BjSX9Otvs1SyQiDg/
IoZFxLCBAwf28nTMzMzMzMwWctKhO/YGngc2r5RtIGkK8Hvg6Xzq3lNqUNbqKfhIYGy+Hpvve2Jr
4M6IeDFvaH8G7FQ5/hLwsqQRwCPAaz3sv94Y4O6IqO0V0dPzBfgysE9EDAIuAn6wmDH1VVyNnERZ
vrE18EHghHc7i7g2IjahJI6+U2mzXkQMAz4H/FDSBm3i6UdZBrIz5fu/UNLqvYjVzMzMzMysx5x0
6GO5GeDuwHbAlyvT7mt7OmxIWX6xb7M+WpgDrFt5P4hcPtAgjgGUGQoXSppNmX1xcE7Fn8+i333/
ZqfTQUxXAmfTy6UV7w4knQysCRxfKe74fLOPNSl7IdxXie0TSzquZiLi+Vyi8SYlQfKepTIRcTcl
YTUw39eWi8wC7gSGAnMpSzz6NYhnDvCLiHg7l+Q8RklCmJmZmZmZdZ2TDn0ob+jPoSyreJqygeD3
q3Ui4nngRMpT7p4aB4yQtLyk9Sk3j/c3qXsgZd+Bj0TE4IhYF3iSss/EU8Cm2c9qwG6Vdq8Cq+Tr
+4BPShqYG1aOBO6qG+da4HTg1l6cDwCSPg/sCYyMiOqeC+OAw/LXIrYDXsnPr5mXgdUkbZzvd6fM
wFjScTXrf+38V5QZDbVf/tgwy8glMcsBv1f5NZTls3wgZb+Oh3P/h/GU7xzgcOAX+fo6YJdKm42B
WT2N1czMzMzMrDecdOhbX6Asnbgt34+hTJ//SF2964AVJe3Yk84jYgZl88aHKfsLHJMbUzYykpIQ
qPo58Ln8lY2rgGmUJRMPVuqcD9wsaXzeSJ9EuaGdCkyOiF9UO4yIVyPitPq9K9JukuZU/v62Sazn
AmsB9+ZPQX4zy2+i3CDPBC4ARtcaqPxc59WVMfbMJSBfAH4uaSplH4avZv2tc5+Hg4DzJM1o1Vdv
42qkRf8/kzQdmA4MBL6b5QcAD+VynLOBgzOx8DFgUp7beODUiHg425wAHC9pJmWPh59k+a2UhMXD
2earEfH7VvGamZmZmZn1FS3cJN/MrBgzZkyMHt0yl2JmZmZmZn/ZOlmO75kOZmZmZmZmZtYd/dpX
sfdbTr8/ra74yYgY3qDuAOCOBt3strRNo5d0LbB+XfEJEdHr/SCWFpK2AC6rK34zIrZdEvGYmZmZ
mZktDZx0WArlTXhHN+KZWBjS3Yj6RqOkyf8VETGdP5PvwczMzMzM7P3i5RVmZmZmZmZm1hVOOpiZ
mZmZmZlZVzjpYGZmZmZmZmZd4aSDmZmZmZmZmXWFkw5mZmZmZmZm1hVOOpiZmZmZmZlZVzjpYGZm
ZmZmZmZd4aSDmZmZmZmZmXWFkw5mZmZmZmZm1hVOOpiZmZmZmZlZVzjpYGZmZmZmZmZd4aSDmZmZ
mZmZmXWFkw5mZmZmZmZm1hVOOpiZmZmZmZlZVzjp0IckvSNpiqQZkqZKOl7SB/LYzpJekfSgpEcl
fb/SbpSkF7PtFEmXthjjg5Juk/R4/rtGB3H9QtK9HZ7DYEmf66DezpJC0pGVsqFZ9pV8f7GkAzvo
a4ike/Nzmybp4Mqx9SXdl+d7paTlsnwnSZMlza8fQ9Lp2dcjks6SpCw/RdIzkubV1W/YV2/ianJ+
rWKtXTNTJI1r0PZH1Xjzmno447lD0kcqxw7PeB6XdHil/E5Jj1XG+VCzWM3MzMzMzPqSkw596/WI
GBIRmwG7A/sAJ1eO3xMRQ4GhwKclbV85dmW2HRIRh7UY40TgjojYCLgj3zclaXXg48Dqktbv4BwG
A22TDmk6cHDl/Qhgaodtq14DDsvPbS/ghxk3wGnAmXm+LwO1JMfTwCjg8mpHkj4BbA9sCWwObA18
Mg9fD2zTYPyGffUyrkaa9Q8Lr5khEbFv3bkMA1avq/8gMCwitgSuAU7Puh+kXGvb5jmeXJeQOqQy
zgstYjUzMzMzM+szTjp0Sd7YHQUcW3vSXjn2OjAFWKcXXe8HXJKvLwH2b1P/AMrN9lhKUgB47yyE
ytP0U4Ed84n4lyX1l3SRpOk5S2OXSt9PA/0lrZXnuBdwc09PKCJ+GxGP5+vngBeANbPPXSk314uc
b0TMjohpwIL67oD+wHLA8sCywO+yzcSIeL7B+A376k1cTc6vWaxNSVoGOAP417q+xkfEa/l2IjAo
X+8J3BYRL0XEy8BtlO+jY5KOkjRJ0qS5c+f2pKmZmZmZmVlDTjp0UUTMonzGi0xnzyfQGwF3V4oP
rkx/P6JFt2vVbpzz33ZT5UcCV+TfyA7CPpEyI2NIRJwJHJNjbZHtL5HUv1L/GuAg4BPAZODNDsZo
StI2lITBE8AA4A8RMT8Pz6FNoiYi7gXGA8/n360R8cjixNQXcbXQP2/0J0qqJi6OBcY1SpJUHMnC
JM86wDOVY/UxXZTX1jfqk2A1EXF+RAyLiGEDBw7sxamYmZmZmZktqt+SDuAvQPUGb0dJ04C/Bk6N
iP+tHLsyIo7t04GltYANgQkREbmnwOYR8VAPutkB+BFARDwq6Slg48rxq4ArgU0oiY1PLEa8awOX
AYdHxIImN8fRpo8NgY+xcAbAbZJ2ioi7WzTrelwtrBcRz0n6KPArSdOB1ymJnJ1bxPQPwDAWLh1p
FdMhEfGspFWAnwOHAk33DTEzMzMzM+srnunQRXkj+Q5lWj6UGQRbAlsAR0sa0otuf5c3wbWb4Vbr
8w8G1gCelDSbsl9DbYnFfPL7z5voZhshNnwqXpOJk7cpe1jc0dEZNBpEWhW4Efh6REzM4rmUvShq
ybFBwHNtuhoOTIyIeRExjzITYLulIK6GctlGbVbMnZT9PoZSkkUz83tbUdLMSkyfAr4G7BsRtZkl
c4B1K12/G1NEPJv/vkrZV6LRvhZmZmZmZmZ9zkmHLpG0JnAu8OOIWOQpeET8FvgecEIvuh4H1H6Z
4HDgFy3qjgT2iojBETEY2IqFSYfZ+R7KPhHL5utXgVUqfdwNHAIgaWNgPeCxunG+CZwQEe/08FzI
fpcDrgUujYira+X5uY0HantPtDtfKPtMfFJSP0nLUmYC9Gp5RR/H1aj/NSQtn68HUjbAfDgiboyI
v6p8b69FxIZZbyhwHiXhUE043QrskX2uAewB3Jqfw8BsuyzwaaAnM13MzMzMzMx6zUmHvrVCrpuf
AdwO/BL49yZ1zwV26vAXJapOBXaX9DhldsGpjSpJGkxJENSezhMRTwJ/lLQtcAHl5vx+yi8e/Cmr
TQPmq/zk55eBMcAyOe3/SmBU5el6rd//iYjrmsR7nqQ5+dfsZzs/C+wEjKrsa1GbBXICcHw+6R8A
/CTPb2tJcyjLEM7LzxzKHhNPUH5ZYyowNSKuzzanZ5sVM55vtemrx3E10qL/jwGTJE2lJDFOjYiH
m/WTzgBWBq5W5Wc2I+Il4DvAA/n37SxbnpJ8mEbZvPRZyndvZmZmZmbWdap7CG9mxpgxY2L06NFL
OgwzMzMzM1t6tVyKX+OZDmZmZmZmZmbWFf71iqWUpLMpa/yr/jMiLmpQ9wjgn+uKfx0Rx3Qrvt6Q
tAXlVyCq3oyIbZdEPH1N0tcoSyiqro6IU5ZEPGZmZmZmZkual1eY2Xt4eYWZmZmZmbXh5RVmZmZm
ZmZmtuQ46WBmZmZmZmZmXeGkg5mZmZmZmZl1hZMOZmZmZmZmZtYVTjqYmZmZmZmZWVc46WBmZmZm
ZmZmXeGkg5mZmZmZmZl1hZMOZmZmZmZmZtYVTjqYmZmZmZmZWVc46WBmZmZmZmZmXeGkg5mZmZmZ
mZl1hZMOZmZmZmZmZtYVTjqYmZmZmZmZWVc46WBmZmZmZmZmXeGkQx+S9I6kKZJmSJoq6XhJH8hj
O0t6RdKDkh6V9P1Ku1GSXsy2UyRd2mKMD0q6TdLj+e8aHcT1C0n3dngOgyV9roN6O0sKSUdWyoZm
2Vfy/cWSDuygryGS7s3PbZqkgyvH1pd0X57vlZKWy/KdJE2WNL9+DEmnZ1+PSDpLkrL8FEnPSJpX
V79hX72Jq8n5tYq1ds1MkTSuUv6TvIamSbpG0spZXn+tfL7S5vCM53FJh1fKl5N0vqTf5rV3QLvv
xMzMzMzMrC846dC3Xo+IIRGxGbA7sA9wcuX4PRExFBgKfFrS9pVjV2bbIRFxWIsxTgTuiIiNgDvy
fVOSVgc+Dqwuaf0OzmEw0DbpkKYDB1fejwCmdti26jXgsPzc9gJ+mHEDnAacmef7MlBLcjwNjAIu
r3Yk6RPA9sCWwObA1sAn8/D1wDYNxm/YVy/jaqRZ/7DwmhkSEftWyr8cEX8TEVtm+2Mrx6rXyoV5
3h+kXGvb5jmeXElIfQ14ISI2BjYF7moRq5mZmZmZWZ9x0qFLIuIF4Cjg2NqT9sqx14EpwDq96Ho/
4JJ8fQmwf5v6B1ButsdSkgLAe2chVJ7+nwrsmE/Rvyypv6SLJE3PWRq7VPp+Gugvaa08x72Am3t6
QhHx24h4PF8/B7wArJl97gpcU3++ETE7IqYBC+q7A/oDywHLA8sCv8s2EyPi+QbjN+yrN3E1Ob9m
sTYVEX8EyLFWyPNqZU/gtoh4KSJeBm6jfB8A/w/4Xva7ICLmNupA0lGSJkmaNHduwypmZmZmZmY9
4qRDF0XELMpn/KFqeT6B3gi4u1J8cGXK/BEtul2rduOc/36oRV2AkcAV+Teyg7BPpMzIGBIRZwLH
5FhbZPtLJPWv1L8GOAj4BDAZeLODMZqStA0lYfAEMAD4Q0TMz8NzaJOoiYh7gfHA8/l3a0Q8sjgx
9UVcLfTPG/2JkhZJXEi6CPhfYBPgR5VDB1SWXaybZesAz1TqzAHWqczM+E4u8bha0lqNAomI8yNi
WEQMGzhwYC9Px8zMzMzMbCEnHbqvOsthR0nTKDeSN0TE/1aOVafMX9QnA5ebyw2BCRHxW2C+pM17
2M0OwGUAEfEo8BSwceX4VZSkQy25sTjxrp1jHRERC1j0s6tp+cRf0obAx4BBlBvxXSXttKTjamG9
iBhGWdLyQ0kbvNthxBHAh4FHWLiM5XpgcC67uJ2Fs16axdSP8ln8OiI+DtwLfL9BXTMzMzMzsz7n
pEMXSfoo8A5lWj6UGQRbAlsAR0sa0otuf5c3wbWb4Rda1D0YWAN4UtJsyn4NtSUW88nvP6fwN9sI
sdHN7LsycfI2ZQ+LOzo6g0aDSKsCNwJfj4iJWTyXshdFv3w/CHiuTVfDgYkRMS8i5lGWe2y3FMTV
UC7bqM2KuZOy30f1+DvAlZRlMkTE7yOiNpvkAmCrfD0HWLfStBbT7yl7U1yb5VdT9vgwMzMzMzPr
OicdukTSmsC5wI8jYpGn4Dnr4HvACb3oehxQ+2WCw4FftKg7EtgrIgZHxGDKDWot6TCbhTes+1H2
PgB4FVil0sfdwCEAkjYG1gMeqxvnm8AJeYPcY/nLD9cCl0bE/2/v3qOlqu4Ej39/enlEUEFv8E3Q
IGti2mcUOm1Hid2gMxmlk07H0A8RXcvJEJcmxhmTMSZK0PbV0R5blnYvE7AnPRq1E2NsH+gkdoKP
iBFkUCOGKDKkmyA+uMEX+ps/zr6mgPvi1q263nu/n7VqUXXOPrt+50etqlu/2nufW9q3l7z9CGhf
e6K784VqnYljI6IlIoZRLSLZq+kVfRxXR/2PjYgR5X4r1QKYT0ZlYtkewInA0+XxXjVdnMTvzu0e
YHrpcywwnWpqSVKNjpha2v0R8OT2xipJkiRJvWHRoW+9r6zJsIJq6Pu9wEWdtL0OOKaHV5SodSkw
LSJWUo0uuLSjRhExgapA0P7rPJn5K+DViJhC9Sv5sRHxM6orHvy2NHuCahrGsoj4IjAf2DEillP9
4n5qzS/t7f0+mJnf7yTe6yNiTbl1dtnOzwDHAKfWrGvRPgrkPOCciHiWai2FG8r5HRURa6imdlxf
cg7VGhO/pLqyxjJgWWbeUY65vByzU4nnwm762u64OtJF/x8ClkTEMqoixqWZ+STV6JKFJefLgb2A
ueWYs6JckhU4i+qqGGTmBuAbwKPlNrdsa4/1wjK156+AL3UWqyRJkiT1pdjqR3hJYv78+Tlnzpz+
DkOSJEnSe1eXU/HbOdJBkiRJkiQ1REv3TdQfIuJaqjn+tf62oytblEtsnr3V5sWZ+flGxdcbEXEw
5UoYNd7IzCn9EU9fi4jzqaZQ1LolMy/uj3gkSZIkqb85vULSNpxeIUmSJKkbTq+QJEmSJEn9x6KD
JEmSJElqCIsOkiRJkiSpISw6SJIkSZKkhrDoIEmSJEmSGsKigyRJkiRJagiLDpIkSZIkqSEsOkiS
JEmSpIaw6CBJkiRJkhrCooMkSZIkSWoIiw6SJEmSJKkhLDpIkiRJkqSGsOggSZIkSZIawqKDJEmS
JElqCIsOfSgi3o6IpRGxIiKWRcQ5EbFD2Tc1Il6JiMcj4umIuLLmuFMj4jfl2KURcWMXz7FbRCyK
iJXl37E9iOv2iHioh+cwISL+vAftpkZERsTpNdsOL9vOLY8XRMSne9DXYRHxUMnbExFxcs2+/SPi
kXK+N0fE8LL9mIj4eURs3vo5IuLy0tdTEfE/IyLK9osj4oWIaNuqfYd99SauTs6vq1jbXzNLI+IH
NdtvKK+hJyLi1ogYXbafExFPlu33R8QHao6ZVeJZGRGzyrada/pfGhHrI+Lq7v5PJEmSJKkvWHTo
W69l5mGZ+WFgGvCfgK/X7P9JZh4OHA7854g4umbfzeXYwzLzlC6e48vA/Zl5IHB/edypiBgDHAGM
iYj9e3AOE4Buiw7FcuDkmsefBZb18Nham4BTSt5OAK4ucQNcBlxVzvcloL3IsRo4Ffin2o4i4g+A
o4FDgN8DjgKOLbvvACZ38Pwd9tXLuDrSWf/wu9fMYZl5Us32L2bmoZl5SDn+zLL9ceDIsv1W4PJy
3rtRvdamlHP8ekSMzcyNNf0fBjwP/HMXsUqSJElSn7Ho0CCZuQ44Aziz/Zf2mn2vAUuBfXrR9Qxg
Ybm/EPiTbtr/KdWX7ZuoigLAtqMQan79vxT4WPlV/IsRMTIivh0Ry8sojY/X9L0aGBkRe5RzPAG4
a3tPKDOfycyV5f5aYB3w/tLncVRfrrc438x8LjOfAN7ZujtgJDAcGAEMA/69HPNwZv66g+fvsK/e
xNXJ+XUWa6cy81WA8lzvK+dFZv4oMzeVZg8D+5b7xwOLMnNDZr4ELKL6/3hXRBwIjAN+0tM4JEmS
JKkeFh0aKDNXUeV4XO32MiXiQOBfazafXDMEfnYX3e7R/sW5/Duui7YAM4H/XW4zexD2l6lGZByW
mVcBny/PdXA5fmFEjKxpfyvwZ8AfAD8H3ujBc3QqIiZTFQx+CewOvJyZm8vuNXRTqMnMh4AfAb8u
t3sy86l6YuqLuLowMiKWRMTDEbFF4SIivg38G/AfgGs6OPZ0flfk2Qd4oWZfRzHNpBpRkx0FEhFn
lFiWrF+/vhenIkmSJElbsujQeLWjHD4WEU9QfZH8YWb+W82+2ukV3+6TJ47YA5gI/DQznwE2R8Tv
bWc3fwj8I0BmPk01PH9Szf7vUhUd2osb9cS7V3mu2Zn5Dlvmrl2HX5hr+pgIfIhqBMA+wHERcUx/
x9WF8Zl5JNWUlqsj4oPvdpg5G9gbeIotp7EQEX8JHAlc0b6pBzF9li7+jzLz7zPzyMw8srW1dbtP
RJIkSZK2ZtGhgSLiAOBtqmH5UI0gOAQ4GPivEXFYL7r99/IluP3L8Lou2p4MjAV+FRHPUa3X0D7F
YjPl/78M4e9sIcSOvsy+qxRO3qJaw+L+Hp1BR08SsQtwJ/DVzHy4bF5PtRZFS3m8L7C2m64+CTyc
mW2Z2UY1EuD33wNxdahM22gfFfNjqvU+ave/DdxMNU2mPaY/Bs4HTsrM9pEla4D9ag7dIqaIOBRo
yczHehOnJEmSJPWGRYcGiYj3A9cBf7f1cPYy6uCvgfN60fUPgFnl/izg9i7azgROyMwJmTkB+Ai/
Kzo8Vx5DtU7EsHJ/I7BzTR//CvwFQERMAsYDv9jqeb4GnFe+IG+3cuWH7wE3ZuYt7dtL3n4EtK89
0d35QrXOxLER0RIRw6gWkezV9Io+jquj/sdGxIhyv5VqAcwnozKxbA/gRODp8vhw4HqqgkNtweke
YHrpcywwvWxrV/dIFEmSJEnaXhYd+tb7ypoMK4D7gHuBizppex1wTA+vKFHrUmBaRKykGl1waUeN
ImICVYGg/dd5MvNXwKsRMQX4B6ov5z+juuLBb0uzJ6imYSyLiC8C84EdI2I51S/up9b8ut7e74OZ
+f1O4r0+ItaUW2eX7fwMcAxwas26Fu2jQM4DzomIZ6nWUrihnN9REbGGamrH9SXnUK0x8UuqK2ss
A5Zl5h3lmMvLMTuVeC7spq/tjqsjXfT/IWBJRCyjKmJcmplPUo0uWVhyvhzYC5hbjrkCGA3cEjWX
2czMDcA3gEfLbW7ZVptjiw6SJEmSmio6WVNO0hA2f/78nDNnTn+HIUmSJOm9q8up+O0c6SBJkiRJ
khqipfsm6g8RcS3VHP9af9vRlS3KJTbP3mrz4sz8fKPi642IOJhyJYwab2TmlP6Ip69FxPlUUyhq
3ZKZF/dHPJIkSZLU35xeIWkbTq+QJEmS1A2nV0iSJEmSpP5j0UGSJEmSJDWEazpIaqgj5y1ifdub
3bZrHT2cJV+d1oSIem/16tUcdNBBPPPMM+y99969biNJkiQNFY50kNRQPSk4bE+7npo6dSojRoxg
9OjR7Lrrrhx++OHcdtttdfU5fvx42tra3i0mLFiwgIkTJ3bZRpIkSRrKLDpIGrQuuOAC2traePHF
F5k5cyYnn3wyzzzzTH+HJUmSJA0ZFh0kDXotLS3MmTOHt99+m+XLl/P8888zY8YMWltb2W+//fjC
F77Aa6+9BkBmcv7557P33nuz8847M2HCBK655hoAnnvuOSKCNWvW8NBDD/G5z32OVatWMXr0aEaP
Hs2Pf/zjLdps2LCBkSNHsnTp0i3iOfbYY5k7dy4Amzdv5pJLLmHSpEmMGTOGo48+mscee6y5CZIk
SZIaxKKDpEHvzTff5Nprr2XYsGEceuihfOITn2DPPffk+eef5+GHH2bx4sWce+65ACxatIiFCxfy
yCOPsHHjRh555BGOPvrobfr86Ec/ynXXXccBBxxAW1sbbW1tTJ06dYs2u+22GyeddBILFix4d9uq
VatYvHgxs2bNAuBrX/sat99+O3fffTcvvvgip512GscffzwvvfRSw/IhSZIkNYtFB0mD1sUXX8yY
MWPYd999uf3227nttttYt24dK1eu5Jvf/CajRo1in332Yd68eXzrW98iMxk+fDivv/46K1as4PXX
X2ePPfbgiCOO6HUMs2fP5jvf+Q5vvfUWUK0D8fGPf5wPfOADZCbXXHMNV1xxBQcccAA77rgjp59+
OnvttRd33nlnX6VBkiRJ6jcWHSQNWueffz4vv/wy69at48EHH+TEE0/khRdeYNy4cYwaNerdM1JR
GQAACPBJREFUdh/84Ad5/fXX+c1vfsPUqVO55JJLmDdvHuPGjeP4449nyZIlvY5h+vTpDB8+nDvu
uIPM5MYbb+S0004DYP369bS1tXHiiScyZsyYd2+rVq1izZo1dZ+/JEmS1N+8ZKakIWW//fZj3bp1
bNq0iZ122gmopjyMHDmS1tZWAM444wzOOOMMNm3axIUXXsinPvUpVq9evU1fO+zQfd12xx135JRT
TmHBggXsuuuuvPLKK3zyk58EoLW1lVGjRnHfffdx1FFH9eFZSpIkSe8NjnSQNKRMnjyZiRMn8qUv
fYlNmzaxdu1aLrjgAmbPns0OO+zAo48+yk9/+lPeeOMNRowYwc4770xLS8f12T333JN169bx6quv
dvmcs2fP5q677uKyyy5j5syZjBw5EoCI4Oyzz+bcc89l5cqVALS1tXHPPfewdu3avj1xSZIkqR9Y
dJA0pLS0tPDDH/6QNWvWMH78eCZPnsyUKVO48sorAdi4cSNnnXUWra2t7L777tx7773cdNNNHfZ1
3HHHMW3aNPbff3/GjBnDAw880GG7SZMmMXnyZBYtWvTu1Ip2F110ETNmzGDGjBnssssuHHjggVx3
3XW88847fXvikiRJUj+IzOzvGCS9x8yfPz/nzJnTJ30dOW8R69ve7LZd6+jhLPnqtD55TkmSJEkN
Fz1p5JoOkhrKQoIkSZI0dDm9QpIkSZIkNYRFB0mSJEmS1BAWHSRJkiRJUkNYdJAkSZIkSQ1h0UGS
JEmSJDWERQdJkiRJktQQFh0kSZIkSVJDWHSQJEmSJEkNYdFBkiRJkiQ1hEUHSZIkSZLUEBYdJEmS
JElSQ1h0kCRJkiRJDRGZ2d8xSHqPOe+88zYOGzbsF/0dx1DR1tbWOnr06PX9HcdQYb6bz5w3l/lu
LvPdfOa8ucx3cw2wfK+fN2/eCd01suggaRsRsSQzj+zvOIYK891c5rv5zHlzme/mMt/NZ86by3w3
12DMt9MrJEmSJElSQ1h0kCRJkiRJDWHRQVJH/r6/AxhizHdzme/mM+fNZb6by3w3nzlvLvPdXIMu
367pIEmSJEmSGsKRDpIkSZIkqSEsOkiSJEmSpIaw6CANIRFxQkT8IiKejYgvd7B/RETcXPY/EhET
avZ9pWz/RUQc38y4B7Le5jwipkXEYxGxvPx7XLNjH4jqeY2X/eMjoi0izm1WzANZne8ph0TEQxGx
orzORzYz9oGqjveUYRGxsOT6qYj4SrNjH4h6kO9jIuLnEbE5Ij691b5ZEbGy3GY1L+qBq7f5jojD
at5PnoiIk5sb+cBVz2u87N8lIv5fRPxdcyIe2Op8TxkfEfeW9/Ant/4b5r3MooM0RETEjsC1wH8E
DgJmRsRBWzU7HXgpMycCVwGXlWMPAj4LfBg4AZhf+lMX6sk5sB44MTMPBmYB/9icqAeuOvPd7irg
rkbHOhjU+Z7SAvwv4HOZ+WFgKvBWk0IfsOp8jf8ZMKK8p3wE+C8D6Q/W/tDDfK8GTgX+aatjdwO+
DkwBJgNfj4ixjY55IKsn38Am4JTyfnICcHVEjGlsxANfnTlv9w3ggUbFOJj0Qb5vBK7IzA9Rva+s
a1y0fcuigzR0TAaezcxVmfkmcBMwY6s2M4CF5f6twB9FRJTtN2XmG5n5K+DZ0p+61uucZ+bjmbm2
bF8BjIyIEU2JeuCq5zVORPwJsIoq3+pePfmeDjyRmcsAMvPFzHy7SXEPZPXkPIFRpeDzPuBN4NXm
hD1gdZvvzHwuM58A3tnq2OOBRZm5ITNfAhZRfRlW53qd78x8JjNXlvtrqb6Mvb85YQ9o9bzGiYiP
AHsA9zYj2EGg1/kuxYmWzFxU2rVl5qYmxV03iw7S0LEP8ELN4zVlW4dtMnMz8Aqwew+P1bbqyXmt
PwUez8w3GhTnYNHrfEfEKOA84KImxDlY1PP6ngRkRNxThpH+9ybEOxjUk/Nbgd8Cv6b6Je3KzNzQ
6IAHuHo++/zc3H59krOImAwMB37ZR3ENZr3OeUTsAPwN8N8aENdgVc9rfBLwckT8c0Q8HhFXDKRR
xy39HYCkpokOtm19zdzO2vTkWG2rnpxXOyM+TDU8enofxjVY1ZPvi4CrMrOtDHxQ9+rJdwvwh8BR
VMOi74+IxzLz/r4NcdCpJ+eTgbeBvYGxwE8i4r7MXNW3IQ4q9Xz2+bm5/erOWUTsRTUdcVZmbvPL
vLZRT87nAP+SmS/4udlj9eS7BfgYcDhV4fhmqmkYN/RJZA3mSAdp6FgD7FfzeF9gbWdtyhDcXYEN
PTxW26on50TEvsD3qOap+otN9+rJ9xTg8oh4DvgC8D8i4sxGBzzA1fue8kBmri/DQ/8FOKLhEQ98
9eT8z4G7M/OtzFwHLAaObHjEA1s9n31+bm6/unIWEbsAdwJfzcyH+zi2waqenH8UOLN8bl4JnBIR
l/ZteINOve8pj5epGZuB7zOAPjctOkhDx6PAgRGxf0QMp1oY8gdbtfkB1aKFAJ8G/k9mZtn+2ahW
Rd8fOBD4WZPiHsh6nfOyANadwFcyc3HTIh7Yep3vzPxYZk7IzAnA1cAlmelK3F2r5z3lHuCQiNip
fDE+FniySXEPZPXkfDVwXFRGAb8PPN2kuAeqnuS7M/cA0yNibFlAcnrZps71Ot+l/feAGzPzlgbG
ONj0OueZ+ReZOb58bp5LlfttrsagLdTznvIoMDYi2tcqOY4B9Llp0UEaIkpV9EyqP3qeAr6bmSsi
Ym5EnFSa3UA1v/1Z4Bzgy+XYFcB3qd7c7gY+76Jv3asn5+W4icAFEbG03MY1+RQGlDrzre1U53vK
S8A3qf6IWgr8PDPvbPY5DDR1vsavBUYD/5cq798ui5WpEz3Jd0QcFRFrqK4Ocn1ErCjHbqBa1f/R
cpvrGhpdqyffwGeAY4BTaz4zD+uH0xhQ6sy5tlOd7ylvUxV37o+I5VRTNf6hP86jN6IqfkuSJEmS
JPUtRzpIkiRJkqSGsOggSZIkSZIawqKDJEmSJElqCIsOkiRJkiSpISw6SJIkSZKkhrDoIEmSJEmS
GsKigyRJkiRJaoj/D3tJt1UkfPCrAAAAAElFTkSuQmCC
"
>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p><strong>Getting a model directly by name</strong></p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[87]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml_leaderboard_df</span><span class="o">.</span><span class="n">head</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[87]:</div>
<div class="output_html rendered_html output_subarea output_execute_result">
<div>
<style>
.dataframe thead tr:only-child th {
text-align: right;
}
.dataframe thead th {
text-align: left;
}
.dataframe tbody tr th {
vertical-align: top;
}
</style>
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>model_id</th>
<th>auc</th>
<th>logloss</th>
<th>mean_per_class_error</th>
<th>rmse</th>
<th>mse</th>
</tr>
</thead>
<tbody>
<tr>
<th>0</th>
<td>StackedEnsemble_AllModels_0_AutoML_20181120_15...</td>
<td>0.707120</td>
<td>0.435531</td>
<td>0.349509</td>
<td>0.370103</td>
<td>0.136977</td>
</tr>
<tr>
<th>1</th>
<td>StackedEnsemble_AllModels_0_AutoML_20181120_15...</td>
<td>0.706222</td>
<td>0.435883</td>
<td>0.351685</td>
<td>0.370262</td>
<td>0.137094</td>
</tr>
<tr>
<th>2</th>
<td>StackedEnsemble_BestOfFamily_0_AutoML_20181120...</td>
<td>0.705212</td>
<td>0.436220</td>
<td>0.350829</td>
<td>0.370407</td>
<td>0.137202</td>
</tr>
<tr>
<th>3</th>
<td>GBM_grid_0_AutoML_20181120_154205_model_0</td>
<td>0.703839</td>
<td>0.435055</td>
<td>0.353507</td>
<td>0.370225</td>
<td>0.137067</td>
</tr>
<tr>
<th>4</th>
<td>GBM_grid_0_AutoML_20181120_153506_model_0</td>
<td>0.703216</td>
<td>0.435227</td>
<td>0.352786</td>
<td>0.370273</td>
<td>0.137102</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[88]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">m_id</span><span class="o">=</span><span class="s1">&#39;&#39;</span>
<span class="k">for</span> <span class="n">model</span> <span class="ow">in</span> <span class="n">aml_leaderboard_df</span><span class="p">[</span><span class="s1">&#39;model_id&#39;</span><span class="p">]:</span>
<span class="k">if</span> <span class="s1">&#39;StackedEnsemble&#39;</span> <span class="ow">not</span> <span class="ow">in</span> <span class="n">model</span><span class="p">:</span>
<span class="nb">print</span> <span class="p">(</span><span class="n">model</span><span class="p">)</span>
<span class="k">if</span> <span class="n">m_id</span><span class="o">==</span><span class="s1">&#39;&#39;</span><span class="p">:</span>
<span class="n">m_id</span><span class="o">=</span><span class="n">model</span>
<span class="nb">print</span> <span class="p">(</span><span class="s2">&quot;model_id &quot;</span><span class="p">,</span> <span class="n">m_id</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>GBM_grid_0_AutoML_20181120_154205_model_0
GBM_grid_0_AutoML_20181120_153506_model_0
GBM_grid_0_AutoML_20181120_153506_model_1
GBM_grid_0_AutoML_20181120_154205_model_1
GBM_grid_0_AutoML_20181120_153506_model_2
GBM_grid_0_AutoML_20181120_154205_model_2
DeepLearning_0_AutoML_20181120_154205
GLM_grid_0_AutoML_20181120_154205_model_0
GLM_grid_0_AutoML_20181120_153506_model_0
DeepLearning_0_AutoML_20181120_153506
GBM_grid_0_AutoML_20181120_154205_model_4
GBM_grid_0_AutoML_20181120_153506_model_4
GBM_grid_0_AutoML_20181120_153506_model_3
GBM_grid_0_AutoML_20181120_154205_model_3
XRT_0_AutoML_20181120_154205
XRT_0_AutoML_20181120_153506
DRF_0_AutoML_20181120_154205
DRF_0_AutoML_20181120_153506
DRF_0_AutoML_20181120_153207
model_id GBM_grid_0_AutoML_20181120_154205_model_0
</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[89]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">non_stacked</span><span class="o">=</span> <span class="n">h2o</span><span class="o">.</span><span class="n">get_model</span><span class="p">(</span><span class="n">m_id</span><span class="p">)</span>
<span class="nb">print</span> <span class="p">(</span><span class="n">non_stacked</span><span class="o">.</span><span class="n">algo</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>gbm
</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[90]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="nb">dir</span><span class="p">(</span><span class="n">non_stacked</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[90]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>[&#39;F0point5&#39;,
&#39;F1&#39;,
&#39;F2&#39;,
&#39;__class__&#39;,
&#39;__delattr__&#39;,
&#39;__dict__&#39;,
&#39;__dir__&#39;,
&#39;__doc__&#39;,
&#39;__eq__&#39;,
&#39;__format__&#39;,
&#39;__ge__&#39;,
&#39;__getattr__&#39;,
&#39;__getattribute__&#39;,
&#39;__gt__&#39;,
&#39;__hash__&#39;,
&#39;__init__&#39;,
&#39;__init_subclass__&#39;,
&#39;__le__&#39;,
&#39;__lt__&#39;,
&#39;__module__&#39;,
&#39;__ne__&#39;,
&#39;__new__&#39;,
&#39;__reduce__&#39;,
&#39;__reduce_ex__&#39;,
&#39;__repr__&#39;,
&#39;__setattr__&#39;,
&#39;__sizeof__&#39;,
&#39;__str__&#39;,
&#39;__subclasshook__&#39;,
&#39;__weakref__&#39;,
&#39;_bc&#39;,
&#39;_bcin&#39;,
&#39;_check_targets&#39;,
&#39;_compute_algo&#39;,
&#39;_estimator_type&#39;,
&#39;_future&#39;,
&#39;_get_metrics&#39;,
&#39;_have_mojo&#39;,
&#39;_have_pojo&#39;,
&#39;_id&#39;,
&#39;_is_xvalidated&#39;,
&#39;_job&#39;,
&#39;_keyify_if_h2oframe&#39;,
&#39;_metrics_class&#39;,
&#39;_model_json&#39;,
&#39;_parms&#39;,
&#39;_plot&#39;,
&#39;_requires_training_frame&#39;,
&#39;_resolve_model&#39;,
&#39;_verify_training_frame_params&#39;,
&#39;_xval_keys&#39;,
&#39;accuracy&#39;,
&#39;actual_params&#39;,
&#39;aic&#39;,
&#39;algo&#39;,
&#39;auc&#39;,
&#39;balance_classes&#39;,
&#39;biases&#39;,
&#39;build_tree_one_node&#39;,
&#39;calibrate_model&#39;,
&#39;calibration_frame&#39;,
&#39;categorical_encoding&#39;,
&#39;catoffsets&#39;,
&#39;checkpoint&#39;,
&#39;class_sampling_factors&#39;,
&#39;coef&#39;,
&#39;coef_norm&#39;,
&#39;col_sample_rate&#39;,
&#39;col_sample_rate_change_per_level&#39;,
&#39;col_sample_rate_per_tree&#39;,
&#39;confusion_matrix&#39;,
&#39;cross_validation_fold_assignment&#39;,
&#39;cross_validation_holdout_predictions&#39;,
&#39;cross_validation_metrics_summary&#39;,
&#39;cross_validation_models&#39;,
&#39;cross_validation_predictions&#39;,
&#39;custom_metric_func&#39;,
&#39;deepfeatures&#39;,
&#39;default_params&#39;,
&#39;distribution&#39;,
&#39;download_mojo&#39;,
&#39;download_pojo&#39;,
&#39;error&#39;,
&#39;fallout&#39;,
&#39;find_idx_by_threshold&#39;,
&#39;find_threshold_by_max_metric&#39;,
&#39;fit&#39;,
&#39;fnr&#39;,
&#39;fold_assignment&#39;,
&#39;fold_column&#39;,
&#39;fpr&#39;,
&#39;full_parameters&#39;,
&#39;gains_lift&#39;,
&#39;get_params&#39;,
&#39;get_xval_models&#39;,
&#39;gini&#39;,
&#39;have_mojo&#39;,
&#39;have_pojo&#39;,
&#39;histogram_type&#39;,
&#39;huber_alpha&#39;,
&#39;ignore_const_cols&#39;,
&#39;ignored_columns&#39;,
&#39;is_cross_validated&#39;,
&#39;join&#39;,
&#39;keep_cross_validation_fold_assignment&#39;,
&#39;keep_cross_validation_predictions&#39;,
&#39;learn_rate&#39;,
&#39;learn_rate_annealing&#39;,
&#39;levelone_frame_id&#39;,
&#39;logloss&#39;,
&#39;mae&#39;,
&#39;max_abs_leafnode_pred&#39;,
&#39;max_after_balance_size&#39;,
&#39;max_confusion_matrix_size&#39;,
&#39;max_depth&#39;,
&#39;max_hit_ratio_k&#39;,
&#39;max_per_class_error&#39;,
&#39;max_runtime_secs&#39;,
&#39;mcc&#39;,
&#39;mean_per_class_error&#39;,
&#39;mean_residual_deviance&#39;,
&#39;metalearner&#39;,
&#39;metric&#39;,
&#39;min_rows&#39;,
&#39;min_split_improvement&#39;,
&#39;missrate&#39;,
&#39;mixin&#39;,
&#39;model_id&#39;,
&#39;model_performance&#39;,
&#39;mse&#39;,
&#39;nbins&#39;,
&#39;nbins_cats&#39;,
&#39;nbins_top_level&#39;,
&#39;nfolds&#39;,
&#39;normmul&#39;,
&#39;normsub&#39;,
&#39;ntrees&#39;,
&#39;null_degrees_of_freedom&#39;,
&#39;null_deviance&#39;,
&#39;offset_column&#39;,
&#39;params&#39;,
&#39;parms&#39;,
&#39;partial_plot&#39;,
&#39;plot&#39;,
&#39;pprint_coef&#39;,
&#39;precision&#39;,
&#39;pred_noise_bandwidth&#39;,
&#39;predict&#39;,
&#39;predict_leaf_node_assignment&#39;,
&#39;quantile_alpha&#39;,
&#39;r2&#39;,
&#39;r2_stopping&#39;,
&#39;recall&#39;,
&#39;residual_degrees_of_freedom&#39;,
&#39;residual_deviance&#39;,
&#39;respmul&#39;,
&#39;response_column&#39;,
&#39;respsub&#39;,
&#39;rmse&#39;,
&#39;rmsle&#39;,
&#39;roc&#39;,
&#39;rotation&#39;,
&#39;sample_rate&#39;,
&#39;sample_rate_per_class&#39;,
&#39;save_model_details&#39;,
&#39;save_mojo&#39;,
&#39;score_each_iteration&#39;,
&#39;score_history&#39;,
&#39;score_tree_interval&#39;,
&#39;scoring_history&#39;,
&#39;seed&#39;,
&#39;sensitivity&#39;,
&#39;set_params&#39;,
&#39;show&#39;,
&#39;specificity&#39;,
&#39;start&#39;,
&#39;std_coef_plot&#39;,
&#39;stopping_metric&#39;,
&#39;stopping_rounds&#39;,
&#39;stopping_tolerance&#39;,
&#39;summary&#39;,
&#39;tnr&#39;,
&#39;tpr&#39;,
&#39;train&#39;,
&#39;training_frame&#39;,
&#39;tweedie_power&#39;,
&#39;type&#39;,
&#39;validation_frame&#39;,
&#39;varimp&#39;,
&#39;varimp_plot&#39;,
&#39;weights&#39;,
&#39;weights_column&#39;,
&#39;xval_keys&#39;,
&#39;xvals&#39;]</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>Note that since this is a pandas dataframe the data can be saved.</p>
<p>The type of exploration depends on the learner. If the learner isn't an ensemble then ensemble exploration doesn't make sense.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>Examine the variable importance of the metalearner (combiner) algorithm in the ensemble. This shows us how much each base learner is contributing to the ensemble. The AutoML Stacked Ensembles use the default metalearner algorithm (GLM with non-negative weights), so the variable importance of the metalearner is actually the standardized coefficient magnitudes of the GLM.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Save-Leader-Model">Save Leader Model<a class="anchor-link" href="#Save-Leader-Model">&#182;</a></h2><p>There are two ways to save the leader model -- binary format and MOJO format. If you're taking your leader model to production, then we'd suggest the MOJO format since it's optimized for production use.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[91]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">h2o</span><span class="o">.</span><span class="n">save_model</span><span class="p">(</span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="p">,</span> <span class="n">path</span> <span class="o">=</span> <span class="s2">&quot;./models&quot;</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[91]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&#39;/Users/bear/Documents/INFO_7390/H2O/models/StackedEnsemble_AllModels_0_AutoML_20181120_154205&#39;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[92]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">download_mojo</span><span class="p">(</span><span class="n">path</span> <span class="o">=</span> <span class="s2">&quot;./models&quot;</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[92]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&#39;/Users/bear/Documents/INFO_7390/H2O/models/StackedEnsemble_AllModels_0_AutoML_20181120_154205.zip&#39;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Making-predictions">Making predictions<a class="anchor-link" href="#Making-predictions">&#182;</a></h2><p>If one wants predictions the user will do this on new data.</p>
<p>Here we are taking 10% of original file just to show the syntax</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[93]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="c1"># split into training and test for showing how to predict</span>
<span class="n">train</span><span class="p">,</span> <span class="n">test</span> <span class="o">=</span> <span class="n">df</span><span class="o">.</span><span class="n">split_frame</span><span class="p">([</span><span class="mf">0.8</span><span class="p">])</span>
</pre></div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="Predict-Using-Leader-Model">Predict Using Leader Model<a class="anchor-link" href="#Predict-Using-Leader-Model">&#182;</a></h2><p>If you need to generate predictions on a test set, you can make predictions on the <code>"H2OAutoML"</code> object directly, or on the leader model object.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[94]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">pred</span> <span class="o">=</span> <span class="n">aml</span><span class="o">.</span><span class="n">predict</span><span class="p">(</span><span class="n">test</span><span class="p">)</span>
<span class="n">pred</span><span class="o">.</span><span class="n">head</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>stackedensemble prediction progress: |████████████████████████████████████| 100%
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<table>
<thead>
<tr><th style="text-align: right;"> predict</th><th style="text-align: right;"> p0</th><th style="text-align: right;"> p1</th></tr>
</thead>
<tbody>
<tr><td style="text-align: right;"> 1</td><td style="text-align: right;">0.709939</td><td style="text-align: right;">0.290061 </td></tr>
<tr><td style="text-align: right;"> 1</td><td style="text-align: right;">0.645258</td><td style="text-align: right;">0.354742 </td></tr>
<tr><td style="text-align: right;"> 1</td><td style="text-align: right;">0.701456</td><td style="text-align: right;">0.298544 </td></tr>
<tr><td style="text-align: right;"> 0</td><td style="text-align: right;">0.865275</td><td style="text-align: right;">0.134725 </td></tr>
<tr><td style="text-align: right;"> 0</td><td style="text-align: right;">0.899026</td><td style="text-align: right;">0.100974 </td></tr>
<tr><td style="text-align: right;"> 0</td><td style="text-align: right;">0.865134</td><td style="text-align: right;">0.134866 </td></tr>
<tr><td style="text-align: right;"> 1</td><td style="text-align: right;">0.624003</td><td style="text-align: right;">0.375997 </td></tr>
<tr><td style="text-align: right;"> 0</td><td style="text-align: right;">0.921187</td><td style="text-align: right;">0.0788131</td></tr>
<tr><td style="text-align: right;"> 0</td><td style="text-align: right;">0.903194</td><td style="text-align: right;">0.0968065</td></tr>
<tr><td style="text-align: right;"> 0</td><td style="text-align: right;">0.925731</td><td style="text-align: right;">0.0742695</td></tr>
</tbody>
</table>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[94]:</div>
<div class="output_text output_subarea output_execute_result">
<pre></pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h2 id="model_performance()">model_performance()<a class="anchor-link" href="#model_performance()">&#182;</a></h2><p>The standard <code>model_performance()</code> method can be applied to the AutoML leader model and a test set to generate an H2O model performance object.</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[95]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">perf</span> <span class="o">=</span> <span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">model_performance</span><span class="p">(</span><span class="n">test</span><span class="p">)</span>
<span class="n">perf</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on test data. **
MSE: 0.13055715415749164
RMSE: 0.36132693527813786
LogLoss: 0.41655140391705325
Null degrees of freedom: 32682
Residual degrees of freedom: 32671
Null deviance: 31504.82333185961
Residual deviance: 27228.299068442102
AIC: 27252.299068442102
AUC: 0.764167884838059
Gini: 0.528335769676118
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21295302564978025:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>20323.0</td>
<td>6247.0</td>
<td>0.2351</td>
<td> (6247.0/26570.0)</td></tr>
<tr><td>1</td>
<td>2383.0</td>
<td>3730.0</td>
<td>0.3898</td>
<td> (2383.0/6113.0)</td></tr>
<tr><td>Total</td>
<td>22706.0</td>
<td>9977.0</td>
<td>0.2641</td>
<td> (8630.0/32683.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.2129530</td>
<td>0.4636420</td>
<td>234.0</td></tr>
<tr><td>max f2</td>
<td>0.1407219</td>
<td>0.6066398</td>
<td>306.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3219515</td>
<td>0.4539944</td>
<td>156.0</td></tr>
<tr><td>max accuracy</td>
<td>0.4260168</td>
<td>0.8235168</td>
<td>99.0</td></tr>
<tr><td>max precision</td>
<td>0.6726948</td>
<td>0.8888889</td>
<td>9.0</td></tr>
<tr><td>max recall</td>
<td>0.0679730</td>
<td>1.0</td>
<td>393.0</td></tr>
<tr><td>max specificity</td>
<td>0.7559667</td>
<td>0.9999624</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2294254</td>
<td>0.3180632</td>
<td>221.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1851642</td>
<td>0.6908228</td>
<td>260.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1802490</td>
<td>0.6935079</td>
<td>265.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.70 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100052</td>
<td>0.5792591</td>
<td>3.9240181</td>
<td>3.9240181</td>
<td>0.7339450</td>
<td>0.7339450</td>
<td>0.0392606</td>
<td>0.0392606</td>
<td>292.4018148</td>
<td>292.4018148</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200104</td>
<td>0.5330392</td>
<td>3.3681156</td>
<td>3.6460669</td>
<td>0.6299694</td>
<td>0.6819572</td>
<td>0.0336987</td>
<td>0.0729593</td>
<td>236.8115577</td>
<td>264.6066862</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300156</td>
<td>0.4993342</td>
<td>3.0738142</td>
<td>3.4553160</td>
<td>0.5749235</td>
<td>0.6462793</td>
<td>0.0307541</td>
<td>0.1037134</td>
<td>207.3814216</td>
<td>245.5315980</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400208</td>
<td>0.4721518</td>
<td>2.6977625</td>
<td>3.2659276</td>
<td>0.5045872</td>
<td>0.6108563</td>
<td>0.0269917</td>
<td>0.1307051</td>
<td>169.7762476</td>
<td>226.5927604</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500260</td>
<td>0.4484122</td>
<td>2.9430136</td>
<td>3.2013448</td>
<td>0.5504587</td>
<td>0.5987768</td>
<td>0.0294454</td>
<td>0.1601505</td>
<td>194.3013611</td>
<td>220.1344805</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000214</td>
<td>0.3612914</td>
<td>2.3820279</td>
<td>2.7918117</td>
<td>0.4455324</td>
<td>0.5221780</td>
<td>0.1190905</td>
<td>0.2792410</td>
<td>138.2027907</td>
<td>179.1811672</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500168</td>
<td>0.3076471</td>
<td>1.9992020</td>
<td>2.5276623</td>
<td>0.3739290</td>
<td>0.4727718</td>
<td>0.0999509</td>
<td>0.3791919</td>
<td>99.9201994</td>
<td>152.7662332</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2000122</td>
<td>0.2681940</td>
<td>1.7145366</td>
<td>2.3244120</td>
<td>0.3206854</td>
<td>0.4347560</td>
<td>0.0857190</td>
<td>0.4649108</td>
<td>71.4536571</td>
<td>132.4411989</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000031</td>
<td>0.2147773</td>
<td>1.3873349</td>
<td>2.0120848</td>
<td>0.2594859</td>
<td>0.3763386</td>
<td>0.1387208</td>
<td>0.6036316</td>
<td>38.7334935</td>
<td>101.2084828</td></tr>
<tr><td></td>
<td>10</td>
<td>0.3999939</td>
<td>0.1779800</td>
<td>1.0993975</td>
<td>1.7839304</td>
<td>0.2056304</td>
<td>0.3336648</td>
<td>0.1099297</td>
<td>0.7135613</td>
<td>9.9397496</td>
<td>78.3930449</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000153</td>
<td>0.1507619</td>
<td>0.8880807</td>
<td>1.6047276</td>
<td>0.1661058</td>
<td>0.3001469</td>
<td>0.0888271</td>
<td>0.8023884</td>
<td>-11.1919310</td>
<td>60.4727606</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6000061</td>
<td>0.1301321</td>
<td>0.6854874</td>
<td>1.4515365</td>
<td>0.1282130</td>
<td>0.2714941</td>
<td>0.0685425</td>
<td>0.8709308</td>
<td>-31.4512573</td>
<td>45.1536534</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999969</td>
<td>0.1126705</td>
<td>0.5137066</td>
<td>1.3175725</td>
<td>0.0960832</td>
<td>0.2464376</td>
<td>0.0513659</td>
<td>0.9222967</td>
<td>-48.6293432</td>
<td>31.7572537</td></tr>
<tr><td></td>
<td>14</td>
<td>0.7999878</td>
<td>0.0979212</td>
<td>0.4466302</td>
<td>1.2087131</td>
<td>0.0835373</td>
<td>0.2260766</td>
<td>0.0446589</td>
<td>0.9669557</td>
<td>-55.3369767</td>
<td>20.8713077</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999786</td>
<td>0.0825174</td>
<td>0.2486732</td>
<td>1.1020492</td>
<td>0.0465116</td>
<td>0.2061263</td>
<td>0.0248650</td>
<td>0.9918207</td>
<td>-75.1326757</td>
<td>10.2049237</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0605814</td>
<td>0.0817754</td>
<td>1.0</td>
<td>0.0152952</td>
<td>0.1870391</td>
<td>0.0081793</td>
<td>1.0</td>
<td>-91.8224614</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[95]:</div>
<div class="output_text output_subarea output_execute_result">
<pre></pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[96]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="nb">dir</span><span class="p">(</span><span class="n">perf</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[96]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>[&#39;F0point5&#39;,
&#39;F1&#39;,
&#39;F2&#39;,
&#39;__class__&#39;,
&#39;__delattr__&#39;,
&#39;__dict__&#39;,
&#39;__dir__&#39;,
&#39;__doc__&#39;,
&#39;__eq__&#39;,
&#39;__format__&#39;,
&#39;__ge__&#39;,
&#39;__getattr__&#39;,
&#39;__getattribute__&#39;,
&#39;__getitem__&#39;,
&#39;__gt__&#39;,
&#39;__hash__&#39;,
&#39;__init__&#39;,
&#39;__init_subclass__&#39;,
&#39;__le__&#39;,
&#39;__lt__&#39;,
&#39;__module__&#39;,
&#39;__ne__&#39;,
&#39;__new__&#39;,
&#39;__reduce__&#39;,
&#39;__reduce_ex__&#39;,
&#39;__repr__&#39;,
&#39;__setattr__&#39;,
&#39;__sizeof__&#39;,
&#39;__str__&#39;,
&#39;__subclasshook__&#39;,
&#39;__weakref__&#39;,
&#39;_algo&#39;,
&#39;_bc&#39;,
&#39;_bcin&#39;,
&#39;_has&#39;,
&#39;_metric_json&#39;,
&#39;_on_train&#39;,
&#39;_on_valid&#39;,
&#39;_on_xval&#39;,
&#39;accuracy&#39;,
&#39;aic&#39;,
&#39;auc&#39;,
&#39;confusion_matrix&#39;,
&#39;custom_metric_name&#39;,
&#39;custom_metric_value&#39;,
&#39;error&#39;,
&#39;fallout&#39;,
&#39;find_idx_by_threshold&#39;,
&#39;find_threshold_by_max_metric&#39;,
&#39;fnr&#39;,
&#39;fpr&#39;,
&#39;fprs&#39;,
&#39;gains_lift&#39;,
&#39;gini&#39;,
&#39;logloss&#39;,
&#39;mae&#39;,
&#39;make&#39;,
&#39;max_per_class_error&#39;,
&#39;mcc&#39;,
&#39;mean_per_class_error&#39;,
&#39;mean_residual_deviance&#39;,
&#39;metric&#39;,
&#39;missrate&#39;,
&#39;mse&#39;,
&#39;nobs&#39;,
&#39;null_degrees_of_freedom&#39;,
&#39;null_deviance&#39;,
&#39;plot&#39;,
&#39;precision&#39;,
&#39;r2&#39;,
&#39;recall&#39;,
&#39;residual_degrees_of_freedom&#39;,
&#39;residual_deviance&#39;,
&#39;rmse&#39;,
&#39;rmsle&#39;,
&#39;sensitivity&#39;,
&#39;show&#39;,
&#39;specificity&#39;,
&#39;tnr&#39;,
&#39;tpr&#39;,
&#39;tprs&#39;]</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[97]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">d</span><span class="o">=</span><span class="n">perf</span><span class="o">.</span><span class="n">confusion_matrix</span><span class="p">()</span>
<span class="n">d</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21295302564978025:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>20323.0</td>
<td>6247.0</td>
<td>0.2351</td>
<td> (6247.0/26570.0)</td></tr>
<tr><td>1</td>
<td>2383.0</td>
<td>3730.0</td>
<td>0.3898</td>
<td> (2383.0/6113.0)</td></tr>
<tr><td>Total</td>
<td>22706.0</td>
<td>9977.0</td>
<td>0.2641</td>
<td> (8630.0/32683.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[97]:</div>
<div class="output_text output_subarea output_execute_result">
<pre></pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[98]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="nb">dir</span><span class="p">(</span><span class="n">perf</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[98]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>[&#39;F0point5&#39;,
&#39;F1&#39;,
&#39;F2&#39;,
&#39;__class__&#39;,
&#39;__delattr__&#39;,
&#39;__dict__&#39;,
&#39;__dir__&#39;,
&#39;__doc__&#39;,
&#39;__eq__&#39;,
&#39;__format__&#39;,
&#39;__ge__&#39;,
&#39;__getattr__&#39;,
&#39;__getattribute__&#39;,
&#39;__getitem__&#39;,
&#39;__gt__&#39;,
&#39;__hash__&#39;,
&#39;__init__&#39;,
&#39;__init_subclass__&#39;,
&#39;__le__&#39;,
&#39;__lt__&#39;,
&#39;__module__&#39;,
&#39;__ne__&#39;,
&#39;__new__&#39;,
&#39;__reduce__&#39;,
&#39;__reduce_ex__&#39;,
&#39;__repr__&#39;,
&#39;__setattr__&#39;,
&#39;__sizeof__&#39;,
&#39;__str__&#39;,
&#39;__subclasshook__&#39;,
&#39;__weakref__&#39;,
&#39;_algo&#39;,
&#39;_bc&#39;,
&#39;_bcin&#39;,
&#39;_has&#39;,
&#39;_metric_json&#39;,
&#39;_on_train&#39;,
&#39;_on_valid&#39;,
&#39;_on_xval&#39;,
&#39;accuracy&#39;,
&#39;aic&#39;,
&#39;auc&#39;,
&#39;confusion_matrix&#39;,
&#39;custom_metric_name&#39;,
&#39;custom_metric_value&#39;,
&#39;error&#39;,
&#39;fallout&#39;,
&#39;find_idx_by_threshold&#39;,
&#39;find_threshold_by_max_metric&#39;,
&#39;fnr&#39;,
&#39;fpr&#39;,
&#39;fprs&#39;,
&#39;gains_lift&#39;,
&#39;gini&#39;,
&#39;logloss&#39;,
&#39;mae&#39;,
&#39;make&#39;,
&#39;max_per_class_error&#39;,
&#39;mcc&#39;,
&#39;mean_per_class_error&#39;,
&#39;mean_residual_deviance&#39;,
&#39;metric&#39;,
&#39;missrate&#39;,
&#39;mse&#39;,
&#39;nobs&#39;,
&#39;null_degrees_of_freedom&#39;,
&#39;null_deviance&#39;,
&#39;plot&#39;,
&#39;precision&#39;,
&#39;r2&#39;,
&#39;recall&#39;,
&#39;residual_degrees_of_freedom&#39;,
&#39;residual_deviance&#39;,
&#39;rmse&#39;,
&#39;rmsle&#39;,
&#39;sensitivity&#39;,
&#39;show&#39;,
&#39;specificity&#39;,
&#39;tnr&#39;,
&#39;tpr&#39;,
&#39;tprs&#39;]</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>In R we get plots like:</p>
<pre><code>#compute performance
</code></pre>
<p>perf &lt;- h2o.performance(automl_leader,conv_data.hex)
h2o.confusionMatrix(perf)
h2o.accuracy(perf)
h2o.tpr(perf)</p>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[99]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">algo</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[99]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&#39;stackedensemble&#39;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[100]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="nb">dir</span><span class="p">(</span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="p">)</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[100]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>[&#39;F0point5&#39;,
&#39;F1&#39;,
&#39;F2&#39;,
&#39;__class__&#39;,
&#39;__delattr__&#39;,
&#39;__dict__&#39;,
&#39;__dir__&#39;,
&#39;__doc__&#39;,
&#39;__eq__&#39;,
&#39;__format__&#39;,
&#39;__ge__&#39;,
&#39;__getattr__&#39;,
&#39;__getattribute__&#39;,
&#39;__gt__&#39;,
&#39;__hash__&#39;,
&#39;__init__&#39;,
&#39;__init_subclass__&#39;,
&#39;__le__&#39;,
&#39;__lt__&#39;,
&#39;__module__&#39;,
&#39;__ne__&#39;,
&#39;__new__&#39;,
&#39;__reduce__&#39;,
&#39;__reduce_ex__&#39;,
&#39;__repr__&#39;,
&#39;__setattr__&#39;,
&#39;__sizeof__&#39;,
&#39;__str__&#39;,
&#39;__subclasshook__&#39;,
&#39;__weakref__&#39;,
&#39;_bc&#39;,
&#39;_bcin&#39;,
&#39;_check_targets&#39;,
&#39;_compute_algo&#39;,
&#39;_estimator_type&#39;,
&#39;_future&#39;,
&#39;_get_metrics&#39;,
&#39;_have_mojo&#39;,
&#39;_have_pojo&#39;,
&#39;_id&#39;,
&#39;_is_xvalidated&#39;,
&#39;_job&#39;,
&#39;_keyify_if_h2oframe&#39;,
&#39;_metrics_class&#39;,
&#39;_model_json&#39;,
&#39;_parms&#39;,
&#39;_plot&#39;,
&#39;_requires_training_frame&#39;,
&#39;_resolve_model&#39;,
&#39;_verify_training_frame_params&#39;,
&#39;_xval_keys&#39;,
&#39;accuracy&#39;,
&#39;actual_params&#39;,
&#39;aic&#39;,
&#39;algo&#39;,
&#39;auc&#39;,
&#39;base_models&#39;,
&#39;biases&#39;,
&#39;catoffsets&#39;,
&#39;coef&#39;,
&#39;coef_norm&#39;,
&#39;confusion_matrix&#39;,
&#39;cross_validation_fold_assignment&#39;,
&#39;cross_validation_holdout_predictions&#39;,
&#39;cross_validation_metrics_summary&#39;,
&#39;cross_validation_models&#39;,
&#39;cross_validation_predictions&#39;,
&#39;deepfeatures&#39;,
&#39;default_params&#39;,
&#39;download_mojo&#39;,
&#39;download_pojo&#39;,
&#39;error&#39;,
&#39;fallout&#39;,
&#39;find_idx_by_threshold&#39;,
&#39;find_threshold_by_max_metric&#39;,
&#39;fit&#39;,
&#39;fnr&#39;,
&#39;fpr&#39;,
&#39;full_parameters&#39;,
&#39;gains_lift&#39;,
&#39;get_params&#39;,
&#39;get_xval_models&#39;,
&#39;gini&#39;,
&#39;have_mojo&#39;,
&#39;have_pojo&#39;,
&#39;is_cross_validated&#39;,
&#39;join&#39;,
&#39;keep_levelone_frame&#39;,
&#39;levelone_frame_id&#39;,
&#39;logloss&#39;,
&#39;mae&#39;,
&#39;max_per_class_error&#39;,
&#39;mcc&#39;,
&#39;mean_per_class_error&#39;,
&#39;mean_residual_deviance&#39;,
&#39;metalearner&#39;,
&#39;metalearner_algorithm&#39;,
&#39;metalearner_fold_assignment&#39;,
&#39;metalearner_fold_column&#39;,
&#39;metalearner_nfolds&#39;,
&#39;metalearner_params&#39;,
&#39;metric&#39;,
&#39;missrate&#39;,
&#39;mixin&#39;,
&#39;model_id&#39;,
&#39;model_performance&#39;,
&#39;mse&#39;,
&#39;normmul&#39;,
&#39;normsub&#39;,
&#39;null_degrees_of_freedom&#39;,
&#39;null_deviance&#39;,
&#39;params&#39;,
&#39;parms&#39;,
&#39;partial_plot&#39;,
&#39;plot&#39;,
&#39;pprint_coef&#39;,
&#39;precision&#39;,
&#39;predict&#39;,
&#39;predict_leaf_node_assignment&#39;,
&#39;r2&#39;,
&#39;recall&#39;,
&#39;residual_degrees_of_freedom&#39;,
&#39;residual_deviance&#39;,
&#39;respmul&#39;,
&#39;response_column&#39;,
&#39;respsub&#39;,
&#39;rmse&#39;,
&#39;rmsle&#39;,
&#39;roc&#39;,
&#39;rotation&#39;,
&#39;save_model_details&#39;,
&#39;save_mojo&#39;,
&#39;score_history&#39;,
&#39;scoring_history&#39;,
&#39;seed&#39;,
&#39;sensitivity&#39;,
&#39;set_params&#39;,
&#39;show&#39;,
&#39;specificity&#39;,
&#39;start&#39;,
&#39;std_coef_plot&#39;,
&#39;summary&#39;,
&#39;tnr&#39;,
&#39;tpr&#39;,
&#39;train&#39;,
&#39;training_frame&#39;,
&#39;type&#39;,
&#39;validation_frame&#39;,
&#39;varimp&#39;,
&#39;varimp_plot&#39;,
&#39;weights&#39;,
&#39;xval_keys&#39;,
&#39;xvals&#39;]</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[101]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">model_performance</span><span class="p">(</span><span class="n">test</span><span class="p">)</span><span class="o">.</span><span class="n">auc</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[101]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>0.764167884838059</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[102]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">best_perf</span> <span class="o">=</span> <span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">model_performance</span><span class="p">()</span>
<span class="n">best_perf</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on train data. **
MSE: 0.12685990330985406
RMSE: 0.3561739789904002
LogLoss: 0.40703958453227496
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124374.13927893189
Residual deviance: 106607.73758484815
AIC: 106631.73758484815
AUC: 0.7734040182726795
Gini: 0.5468080365453589
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21708051286464972:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>83212.0</td>
<td>23869.0</td>
<td>0.2229</td>
<td> (23869.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9376.0</td>
<td>14498.0</td>
<td>0.3927</td>
<td> (9376.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>92588.0</td>
<td>38367.0</td>
<td>0.2539</td>
<td> (33245.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.2170805</td>
<td>0.4658666</td>
<td>238.0</td></tr>
<tr><td>max f2</td>
<td>0.1410190</td>
<td>0.6067433</td>
<td>309.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3338429</td>
<td>0.4568693</td>
<td>155.0</td></tr>
<tr><td>max accuracy</td>
<td>0.4390853</td>
<td>0.8290100</td>
<td>98.0</td></tr>
<tr><td>max precision</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0676438</td>
<td>1.0</td>
<td>394.0</td></tr>
<tr><td>max specificity</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2335835</td>
<td>0.3269004</td>
<td>224.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1855661</td>
<td>0.6993958</td>
<td>265.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1761337</td>
<td>0.7006208</td>
<td>274.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5809896</td>
<td>4.2290904</td>
<td>4.2290904</td>
<td>0.7709924</td>
<td>0.7709924</td>
<td>0.0423054</td>
<td>0.0423054</td>
<td>322.9090447</td>
<td>322.9090447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5350310</td>
<td>3.4879528</td>
<td>3.8585216</td>
<td>0.6358779</td>
<td>0.7034351</td>
<td>0.0348915</td>
<td>0.0771970</td>
<td>248.7952815</td>
<td>285.8521631</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.5007744</td>
<td>3.1972882</td>
<td>3.6382227</td>
<td>0.5828877</td>
<td>0.6632731</td>
<td>0.0319595</td>
<td>0.1091564</td>
<td>219.7288214</td>
<td>263.8222689</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4718430</td>
<td>2.9436144</td>
<td>3.4645375</td>
<td>0.5366412</td>
<td>0.6316091</td>
<td>0.0294463</td>
<td>0.1386027</td>
<td>194.3614440</td>
<td>246.4537481</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4483865</td>
<td>2.8704357</td>
<td>3.3457716</td>
<td>0.5233002</td>
<td>0.6099572</td>
<td>0.0286923</td>
<td>0.1672950</td>
<td>187.0435684</td>
<td>234.5771560</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3623038</td>
<td>2.4444070</td>
<td>2.8950893</td>
<td>0.4456323</td>
<td>0.5277947</td>
<td>0.1222250</td>
<td>0.2895200</td>
<td>144.4406963</td>
<td>189.5089261</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.3079302</td>
<td>1.9878608</td>
<td>2.5926798</td>
<td>0.3624007</td>
<td>0.4726634</td>
<td>0.0993968</td>
<td>0.3889168</td>
<td>98.7860769</td>
<td>159.2679764</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2684456</td>
<td>1.7116814</td>
<td>2.3724554</td>
<td>0.3120513</td>
<td>0.4325150</td>
<td>0.0855743</td>
<td>0.4744911</td>
<td>71.1681359</td>
<td>137.2455391</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2132009</td>
<td>1.4102670</td>
<td>2.0517178</td>
<td>0.2571014</td>
<td>0.3740423</td>
<td>0.1410321</td>
<td>0.6155232</td>
<td>41.0267006</td>
<td>105.1717765</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1765625</td>
<td>1.1217652</td>
<td>1.8192385</td>
<td>0.2045055</td>
<td>0.3316597</td>
<td>0.1121722</td>
<td>0.7276954</td>
<td>12.1765206</td>
<td>81.9238502</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1503145</td>
<td>0.8745582</td>
<td>1.6302967</td>
<td>0.1594380</td>
<td>0.2972143</td>
<td>0.0874592</td>
<td>0.8151546</td>
<td>-12.5441786</td>
<td>63.0296674</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1300345</td>
<td>0.6769128</td>
<td>1.4714054</td>
<td>0.1234059</td>
<td>0.2682474</td>
<td>0.0676887</td>
<td>0.8828433</td>
<td>-32.3087165</td>
<td>47.1405434</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1129563</td>
<td>0.4959559</td>
<td>1.3320601</td>
<td>0.0904162</td>
<td>0.2428437</td>
<td>0.0495937</td>
<td>0.9324370</td>
<td>-50.4044061</td>
<td>33.2060067</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0978849</td>
<td>0.3920433</td>
<td>1.2145535</td>
<td>0.0714722</td>
<td>0.2214215</td>
<td>0.0392058</td>
<td>0.9716428</td>
<td>-60.7956663</td>
<td>21.4553489</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0824531</td>
<td>0.2194940</td>
<td>1.1039951</td>
<td>0.0400153</td>
<td>0.2012659</td>
<td>0.0219486</td>
<td>0.9935914</td>
<td>-78.0505987</td>
<td>10.3995078</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597755</td>
<td>0.0640840</td>
<td>1.0</td>
<td>0.0116830</td>
<td>0.1823069</td>
<td>0.0064086</td>
<td>1.0</td>
<td>-93.5915993</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[102]:</div>
<div class="output_text output_subarea output_execute_result">
<pre></pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[103]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">best_perf</span><span class="o">.</span><span class="n">plot</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_png output_subarea ">
<img src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAYoAAAEWCAYAAAB42tAoAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz
AAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBo
dHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzt3XecVNX5x/HPAwhEmgUkCiJIURAF
dQV7MDERK4ogKCoY1EBEYyw/uzGmWhKNggUbVrCBooIFIopEmopShAiIskIAaaL05fn9ce7KsOzu
zMLO3J3Z7/v1mtfO3Llz59nLMs+cc+55jrk7IiIiJakSdwAiIlKxKVGIiEiplChERKRUShQiIlIq
JQoRESmVEoWIiJRKiUJEREqlRCE5xcwWmNk6M/vezP5nZkPMrHaRfY42s3+b2RozW21mr5lZmyL7
1DWze83s6+hYc6PH9Ut4XzOzK8xshpn9YGb5ZvaimR2czt9XJBOUKCQXne7utYH2wKHADYVPmNlR
wNvAq8A+QDPgU2CCme0f7VMdGAscBHQG6gJHA8uBDiW857+A3wFXAHsArYBXgFPLGryZVSvra0TS
yTQzW3KJmS0ALnb3MdHjO4GD3P3U6PF4YLq7/7bI60YDy9z9QjO7GPgL0Nzdv0/hPVsCs4Gj3H1y
CfuMA55x90ejx32iOI+NHjswALgSqAa8BXzv7tckHONV4D13/6eZ7QPcDxwPfA/c4+73pXCKRMpM
LQrJWWbWGDgZmBs93pXQMnixmN1fAH4Z3T8ReDOVJBH5BZBfUpIogzOBjkAb4Dmgh5kZgJntDvwK
GGZmVYDXCC2hRtH7X2lmJ+3k+4sUS4lCctErZrYGWAgsBf4Qbd+D8De/uJjXLAYKxx/2LGGfkpR1
/5L8zd1XuPs6YDzgwHHRc92AD919EXAE0MDdb3f3je4+H3gE6FkOMYhsR4lCctGZ7l4H6AQcyNYE
sBLYAuxdzGv2Br6N7i8vYZ+SlHX/kiwsvOOhT3gYcG606Tzg2ej+fsA+Zraq8AbcCDQshxhEtqNE
ITnL3d8DhgB3R49/AD4Euhez+zmEAWyAMcBJZlYrxbcaCzQ2s7xS9vkB2DXh8U+LC7nI46FANzPb
j9Al9XK0fSHwpbvvlnCr4+6npBivSJkoUUiuuxf4pZm1jx5fD/SOLmWtY2a7m9mfgaOAP0b7PE34
MH7ZzA40sypmtqeZ3Whm230Yu/sXwAPAUDPrZGbVzaymmfU0s+uj3aYBXc1sVzNrAfRNFri7fwIs
Ax4F3nL3VdFTk4HvzOw6M/uJmVU1s7ZmdsSOnCCRZJQoJKe5+zLgKeCW6PEHwElAV8K4wleES2iP
jT7wcfcNhAHt2cA7wHeED+f6wKQS3uoKYCAwCFgFzAPOIgw6A9wDbASWAE+ytRspmaFRLM8l/E4F
wOmEy3+/JHSZPQrUS/GYImWiy2NFRKRUalGIiEip0pYozOxxM1tqZjNKeN7M7L6oNMJnZnZYumIR
EZEdl84WxRBC+YOSnAy0jG6XAg+mMRYREdlBaUsU7v4+sKKUXboAT3kwEdjNzMrjWnQRESlHcRYf
a0TCBCMgP9q23QxXM7uU0OqgVq1ahx944IEZCVBEpKw2bgy3zZth06bws0oVaBhNh8zPh7VroaAg
3LZsgZo1oVWr8PzMmbB+/bbHrFNn6/PTp4fjJ9ptN2jePNyfNi0cN9Gee8Ly5R996+4NduR3ijNR
WDHbir0Ey90HA4MB8vLyfOrUqemMS0QECB/IS5fCsmVw6KFh2/PPw7hxYVvhbZdd4NNPw/Onnw6v
v77tcdq0gcKPrX79YNas8OFfu3b4ecABcO214fmXXw6JpE4dqFEjJJn69eHww8PzU6aEBFSlClSt
Gn7uvjvsv394/r//DT+rVNm6T+3aUL++fbWj5yHORJEP7JvwuDGwKKZYRKQSWrMG5s6FL76As88O
H6r33w8PPQT/+x+siDrPq1QJSaNqVXj/fXjxRdhrr/AB3ro1NGq09Zg33wxXXAENGoTn69cPLYZC
Dz1Uekxnn13680ckmVZZ2PIoT3EmipHAADMbRihPsNrdy6OwmogIELpg8vPhyy/DN/I6deDVV+GO
O2DevNBaKLRgAey3H9SrBwceCJ06he6ihg1hn32gcMrZwIEwaFDJ79mxYzp/o3ikLVGY2VBCUbb6
ZpZPqOC5C4C7PwSMAk4hlIBeC1yUrlhEJDe5h2/9X34JzZqFvviJE+HWW2H+fPj669BNAzB+PBx7
bGgV1KwZuohatoQWLcLPffYJ+114YbiVxIrrNM9xaUsU7n5ukucduCxd7y8iucEdFi4MH+577RVa
AtdcE5LDl1/Cd9+F/YYOhZ49QzfRqlWQlwfnnBMSyP77wyGHhP1OOy3cJHVaclFEKpT168MYwCef
hCt4pk2DlStDd9H//V8YOP7vf0MCOO64rYngyCPD6zt0gMk7u4SUbEOJQkRiUdhSmDgx3PbfHwYM
CF07fftCtWpw8MHQvTu0bw8//3l4XZMm4RJSyRwlChHJiIKCMD4AcOml8MYbsCi6zrFmTbj44nC/
Rg34/HNo2nTr/hIvJQoRKXfuYTB54kT48MPwc8OGMFkMQgI44YTQXXTkkdCuXehSKlQ4eUwqBiUK
Edlp69bBxx/D0UeHrqMBA+CBB8JztWuHcYOjjgqzkKtUgQdV2S2rKFGISJlt2QKzZ4cZyq++Gn5u
3BgGmVu2DOMK7dqF1sJBB6kLKdspUYhIUj/8AB98EEpNNG0KI0fCWWeF51q0gMsuCxPUCucidOoU
bpIblChEZDsbNsBbb4XxhUmT4D//CdvuvhuuvjpcljpkSOhqatGick5Cq0yUKESE1avDgHOVKvDL
X4aKp927h0HpQw4JYw6/+lUYZ4AwA7p373hjlsxRohCppEaOhLffDqUtpk8PSeG440KiqFUrtCQO
PHDbgnZSOSlRiOQ491Ahdfz48POvfw3bH3ooVEI9+uhQsfSYY8LVSYXat48nXql4lChEctSUKWEc
4Y034KtoJYIGDUIZ7F13hSeeCF1I1fQpIEmkc81sEcmg+fNDCezFUbH+adPgySdDy+DBB8NiOUuW
hCQBoXy2koSkQn8mIllq06bQdTRqVGg1zJkTtu++O/TqBeefH8pl16gRb5yS/ZQoRLLImjXw7beh
YuqyZXDiiSERdOoEv/0tnHxymPAG8JOfxBqq5BAlCpEKbvlyeO01GD48XKV04olhTeZ99oGxY8OK
arVqxR2l5DIlCpEK7LLL4OGHQ+XVJk2gf/8wv6FQYeltkXRSohCpIGbMgJdfDjOix4wJg87t28N1
10HXrnDYYZoBLfFQohCJ0f/+B489BsOGhURhFmY/L14cSm1fckncEYro8liRjFuyBL7+OtxftCjM
a6hXb+ulrRMmaD0GqVjUohDJgLVrw4D000/Dm2+Gy1YffxwOPTQkjX33jTtCkZIpUYik2e9/D488
Ekp1N24M114bEgWEriYlCanolChEytknn4SWw913h2qsdeuGCXA9esDPfqZFfCT7KFGIlIO1a+Gl
l0LL4YMPwryGfv2gVSv44x/jjk5k52gwW2QnTZ8eJr/17h2uYrrzTsjPD0lCJBeoRSFSRqtXw9Ch
oQvpkkugdWs477zQtXT88ZrrILlHLQqRFH36aUgMe+8dZkiPGBG2V6sGDzwQxh+UJCQXKVGIpOCm
m8Is6WefDa2HyZNDxVaRykBdTyLFWLQIBg8OVyu1bAmnnhoW+bnoolDGW6QyUaIQibiHK5YGDgyV
WgsKQjdTy5ZhudCjj447QpF4KFGIAFu2hBpLkyfDbrvB734XxiFUSkNEYxRSia1cGdaUhjAx7rTT
wjyIb74Jk+WUJEQCtSik0vn2W7jnntDF9N13YeGf1q3hllvijkykYlKLQiqNVatCnaWmTeFvf4OT
TgqXvLZuHXdkIhWbWhSS8zZvDnMdqlaFJ5+EM8+EG2+ENm3ijkwkO6S1RWFmnc1sjpnNNbPri3m+
iZm9a2afmNlnZnZKOuORyuWrr8KAdIcOYbC6Th2YNw+eeUZJQqQs0pYozKwqMAg4GWgDnGtmRf97
3gy84O6HAj2BB9IVj1QO7jBpElxwAbRoEVaP69AhFO2DkCxEpGzS2fXUAZjr7vMBzGwY0AWYlbCP
A3Wj+/WARWmMRyqBt9+Gzp1DQrjsMrjmmrAGhIjsuHQmikbAwoTH+UDHIvvcBrxtZpcDtYATizuQ
mV0KXArQpEmTcg9Uspc7jB4dBqrPOw9+/vMwo7pnT7UeRMpLOscoiiuP5kUenwsMcffGwCnA02a2
XUzuPtjd89w9r0GDBmkIVbLN5s1hYLpjx1Be41//Ckljl11C4T4lCZHyk85EkQ8kLvLYmO27lvoC
LwC4+4dATaB+GmOSHDBxYijQ16cPfP89PPxwKL2hyq0i6ZHOrqcpQEszawZ8QxisPq/IPl8DvwCG
mFlrQqJYlsaYJAds2hQGp4cPD5e6KkGIpFfaEoW7bzazAcBbQFXgcXefaWa3A1PdfSRwNfCImf2e
0C3Vx92Ldk9JJbduHdx1F/zwA9xxBxx3HMyZE7qZRCT90jrhzt1HAaOKbLs14f4s4Jh0xiDZyz0s
DnTVVWFORK9eYZuZkoRIJqmEh1RIEydCXh6cfTbUrQvjxoWJcupmEsm8pC0KM6tOuCLpOGAfYB0w
Axjl7rPTG55UNoUthr32Clc2Pfoo9O4dSnCISDxK/e9nZjcDZwPvAx8B7xAGnFsB95iZAde4+4x0
Byq5bd26MP4wfTq89BLsvz9Mm6YWhEhFkOx72nR3/3MJz91pZnuz7SWwImU2ahRcfjnMnw/nngsb
NkDNmkoSIhVFqWMU7v5qSc+ZWWN3X+zuk8s/LKkMliyBrl3DhLlddoGxY+G550KSEJGKI+lgtpkd
YWZnmln96PFBZvYUMDHt0UlOq1EjdC/99a/w2Weh/IaIVDylJgoz+xvwLNALeNPMbgLeBT4ljFOI
lMm778I554SB6t12C/MhbrgBqlePOzIRKUmyMYouQDt3X2dmexBKcLRz9znpD01yyeLFoZLrc89B
s2ZhXkTz5poPIZINknU9rXf3dQDuvgKYrSQhZfXCC3DggeFqpltugZkzQ5IQkeyQrEWxv5kNj+4b
0DThMe7eNW2RSU4oKIC//AXatoUhQ6Bly7gjEpGySpYozi7yeGC6ApHcMmkStG4dZlW//nqYQFej
RtxRiciOSHZ57FhgKVAH+NrdxybeMhKhZJUlS8LKckcfDbffHrbtu6+ShEg2S3bV043AK4Srnt4x
s19nJCrJSuPHh3UiBg+G3/wGbr01+WtEpOJL1vXUCzjE3X8wswaESrCPpz8syTYjRkD37mGQ+p13
wpiEiOSGZFc9bXD3HwDcfVkK+0slU7h6SIcOoQz45MlKEiK5pqxXPTXXVU9S6PHHwypzr70GjRqF
NaxFJPfoqicps7VrYcAAeOKJUHbjhx+gdu24oxKRdEmWKM5z974ZiUSywty5YTGh6dPD5Lk//AGq
Vo07KhFJp2SJ4tCMRCFZYcuWUO31m29CafDOneOOSEQyIVmi2NXMDiaMT2zH3T8r/5Ckolm7FqpU
CeW/n3wyFPNr1izuqEQkU5IlikbAIIpPFA4cX+4RSYUycSJceCF06QJ33QWHqo0pUukkSxRz3V3J
oBLauBFuuy0sT9q4MZxyStwRiUhctGS9bGf5cujWDcaNg4sugnvvDTWbRKRySpYobsxIFFKhrFoF
U6fC00/D+efHHY2IxC1ZoviNhRXu33H3zYlPmNl+QG8g391V1iPLFRTAm2+GLqbmzcPCQnvsEXdU
IlIRJCvJcRnwS+C/ZvahmY00s7fN7AvgCWCmkkT2++orOOooOO00ePvtsE1JQkQKldqicPdvgKuA
q8ysBbA3sA6Y4+5rMhCfpNm0aaEVsXYtPPss/OpXcUckIhVNyoPZ7j4XmJvGWCTDHnsMLr8c6teH
CRPgoIPijkhEKiJVg63E9tortCAmTVKSEJGSKVFUMp9+GhYWAjj9dHjlFdh773hjEpGKLeVEYWbV
o3EKyVKjR8Oxx8Kf/hQugRURSUVKicLMTgWmA+9Ej9ub2Yh0Bibl6+GHQwuiRYtQlmO33eKOSESy
RaotituBjsAqAHefBqh1kSVuugn69QvjEe+/HxYZEhFJVaqJYpO7F+2s8PIORtKjUaOQKEaOhDp1
4o5GRLJNqoniczM7B6hiZs3M7F5gYrIXmVlnM5tjZnPN7PoS9jnHzGaZ2Uwze64MsUspvvoKxo4N
9/v3hwcegGqq7CUiOyDVj44BwK3AFmA48BZwQ2kvMLOqhBLlvwTygSlmNtLdZyXs0zI6zjHuvtLM
9ir7ryBFTZ8eFhUyCyvS1awZd0Qiks1SbVGc5O7Xufuh0e164OQkr+lAKFM+3903AsOALkX2uQQY
5O4rAdx9aVmCl+299x4cd1xIEm++qSQhIjsv1URxczHbbkrymkbAwoTH+dG2RK2AVmY2wcwmmlmx
i2ua2aVmNtXMpi5btizFkCufl18OA9b77AMffght28YdkYjkglK7nszsJKAz0MjM/pnwVF1CN1Sp
Ly9mW9EB8GpAS6AT0BgYb2Ztiw6cu/tgYDBAXl6eBtFLMGYM5OXBa6+pqJ+IlJ9kYxRLgRnAemBm
wvY1QLGD0wnygX0THjcGFhWzz0R33wR8aWZzCIljSpJjS8Q9TJ7bfXcYOBA2bIBdd407KhHJJcmq
x34CfGJmz7r7+jIeewrQ0syaAd8APYHziuzzCnAuMMTM6hO6ouaX8X0qLXe44QYYNgwmTw61m5Qk
RKS8pTpG0cjMhpnZZ2b238JbaS+IFjoaQLhC6nPgBXefaWa3m9kZ0W5vAcvNbBbwLnCtuy/fwd+l
UikoCJVf77gDTj45VIAVEUmHVC+PHQL8GbibcLXTRSQfo8DdRwGjimy7NeG+E613kWIcQlg74vzz
YcQIuOYauPPOcJWTiEg6pNqi2NXd3wJw93nufjNwQvrCktLccEOo+nrvvXDXXUoSIpJeqbYoNlhY
PHuemfUjjDloclxM/vhHOOmksDKdiEi6pdqi+D1QG7gCOIYwUe7X6QpKtrdyJfzud7BuXaj8qiQh
IpmSUovC3SdFd9cAFwCYWeN0BSXb2rQJuncPlV979ICjj447IhGpTJK2KMzsCDM7M7p8FTM7yMye
IoWigLLzNm2Ciy4KBf4GD1aSEJHMKzVRmNnfgGeBXsCbZnYT4TLWTwlzHiSNNm8OVzc9+yz89a/Q
p0/cEYlIZZSs66kL0M7d15nZHoSZ1e3cfU76Q5P8fBg3Du6+G66+Ou5oRKSySpYo1rv7OgB3X2Fm
s5Uk0s+jalZNm8KsWbDnnrGGIyKVXLJEsb+ZDY/uG9A04THu3jVtkVVS7nDVVbDLLmHWtZKEiMQt
2WD22YTFhwYBA4s8HpTe0Cofd7j22jCRbsOGuKORnTFixAjMjNmzZwMwbtw4TjvttG326dOnDy+9
9BIAmzZt4vrrr6dly5a0bduWDh06MHr06JTea8OGDfTo0YMWLVrQsWNHFixYsN0+c+bMoX379j/e
6taty7333gtAjx49ftzetGlT2rdvD8DkyZN/3N6uXTtGjBixzTELCgo49NBDt/u9JPckKwo4NlOB
VHbucP318I9/wIABIVloxnX2Gjp0KMceeyzDhg3jtttuS7r/LbfcwuLFi5kxYwY1atRgyZIlvPfe
eym912OPPcbuu+/O3LlzGTZsGNdddx3PP//8NvsccMABTJs2DQgf8I0aNeKss84C2Gbfq6++mnr1
6gHQtm1bpk6dSrVq1Vi8eDHt2rXj9NNPp1q0pu6//vUvWrduzXfffZdSnJK9Up1wJ2n2hz+Emk39
+sF99ylJZLPvv/+eCRMm8NhjjzFs2LCk+69du5ZHHnmE+++/nxo1agDQsGFDzjnnnJTe79VXX6V3
794AdOvWjbFjx+Je8rItY8eOpXnz5uy3337bbHd3XnjhBc4991wAdt111x+Twvr167GEP8r8/Hze
eOMNLr744pRilOyWagkPSbODD4b+/cOaEkoS2e2VV16hc+fOtGrVij322IOPP/641P3nzp1LkyZN
qFu3brHP9+jRgzlztr+G5KqrruLCCy/km2++Yd99w9Iv1apVo169eixfvpz6JZQUHjZs2I/JINH4
8eNp2LAhLVu2/HHbpEmT+PWvf81XX33F008//WPiuPLKK7nzzjtZs2ZNqb+b5IYyJQozq+Hu6j0v
RytWhNXouncPN8l+Q4cO5corrwSgZ8+eDB06tMR+fEvhW0HRbqSiims9lHTcjRs3MnLkSP72t79t
99zQoUO3SyAdO3Zk5syZfP755/Tu3ZuTTz6ZMWPGsNdee3H44Yczbty4pPFL9kspUZhZB+AxoB7Q
xMzaARe7++XpDC7Xvf02nH12WHjo1FPjjkbKw/Lly/n3v//NjBkzMDMKCgowMy688EJWrly5zb4r
Vqygfv36tGjRgq+//po1a9ZQp06d7Y6ZrEXRuHFjFi5cSOPGjdm8eTOrV69mjxLWwh09ejSHHXYY
DRs23Gb75s2bGT58OB999FGxr2vdujW1atVixowZTJgwgZEjRzJq1CjWr1/Pd999x/nnn88zzzyT
6mmSbOPuSW+Ech37AZ8kbJuRymvL+3b44Yd7Lvj8c/c6ddzbtXNfvjzuaKS8PPTQQ37ppZdus+34
44/3cePGedOmTX3WrFnu7r5gwQJv0qSJr1q1yt3dr732Wu/Tp49v2LDB3d0XLVrkTz/9dErvOXDg
QP/Nb37j7u5Dhw717t27l7hvjx49/PHHH99u++jRo/3444/fZtv8+fN906ZNP8a79957+7Jly7bZ
59133/VTTz01pTglXsBU38HP3VQHs6u4+1dFthWUW7aqZL77Ds46C2rWhNdeC11PkhuGDh3649VE
hc4++2yGDRvGM888w0UXXUT79u3p1q0bjz766I9XGP35z3+mQYMGtGnThrZt23LmmWfSoEGDlN6z
b9++LF++nBYtWvDPf/6Tv//97wAsWrSIUxLKDK9du5Z33nmHrl23n/5U3LjFBx98QLt27Wjfvj1n
nXUWDzzwQInjHpLbzEu5OuLHncxeBu4AHgKOAC4HjnH3jPeq5+Xl+dSpUzP9tuXGPXQ3jRwJY8ZA
p05xRyQilYGZfeTueTvy2lQHs/sD9wFNgCXAmGiblJF7uMLp+OOVJEQkO6SaKDa7e8+0RlIJLFsG
DRqEFepERLJFqmMUU8xslJn1NrPtL8uQpAYOhNatYd68uCMRESmblBKFuzcH/gwcDkw3s1fMTC2M
FI0ZA1deCcccEyrCiohkk5RLeLj7f9z9CuAw4DvCgkaSxNy5cM45oTXxzDNQtWrcEYmIlE1KicLM
aptZLzN7DZgMLAO0KGcS338PXbpAlSrhKqdi5lKJiFR4qQ5mzwBeA+509/FpjCfntGsHfftCs2Zx
RyIismNSTRT7u/uWtEaSYwoKoHZteO65uCMREdk5pXY9mdk/orsvm9nworcMxJeV3n4b8vLCmtci
ItkuWYuisGzlwHQHkisWLIBzz4V99oHdd487GhGRnZdshbvJ0d3W7r5NsjCzAYBWwEuwbl0oz7F5
MwwfDrVqxR2RiMjOS/Xy2F8Xs61veQaS7dzhssvg44/DZbAJa7+IiGS1UlsUZtYD6Ak0KzImUQdY
lc7Ass2aNfDJJ3DLLXD66XFHIyJSfpKNUUwGlgONgUEJ29cAn6QrqGxUty785z9QvXrckYiIlK9k
YxRfAl8SqsVKMZYuhdtugzvu0IQ6EclNyS6PfS/6udLMViTcVprZisyEWHFt3gw9e8ITT8D8+XFH
IyKSHsm6nk6IfmpZq2LceCO8+y4MGRJmYIuI5KJSWxQJs7H3Baq6ewFwFPAbIOnFn2bW2czmmNlc
M7u+lP26mZmb2Q6tvhSHt96Cu+6Cfv2gd++4oxERSZ9UL499BXAzaw48BbQGSi1OYWZVCQPgJwNt
gHPNrE0x+9UBrgAmlSHuWLnDDTfAAQfAPffEHY2ISHqlmii2uPsmoCtwr7tfDjRK8poOwFx3n+/u
G4FhQJdi9vsTcCewPsVYYmcGb7wBL7wANWvGHY2ISHqlmig2m1l34ALg9WjbLkle0whYmPA4nyLJ
xcwOBfZ199cphZldamZTzWzqsmXLUgw5PebODQX/9t4bDjkk1lBERDKiLDOzTyCUGZ9vZs2AoUle
Y8Vs8x+fNKsC3ANcnezN3X2wu+e5e16DBg1SDLn8LVoUVqm7/PLYQhARybhUl0KdQRhHmGpmBwIL
3f0vSV6WTxgEL9QYWJTwuA7QFhhnZguAI4GRFXVAu/BS2O+/hwED4o5GRCRzUlqPwsyOA54GviG0
FH5qZhe4+4RSXjYFaBm1Pr4hlAI5r/BJd19NwmW3ZjYOuMbdp5b1l8iEO+6A8eNDHac22w3Ji4jk
rlQXLroHOMXdZwGYWWtC4ijx27+7b44qzL4FVAUed/eZZnY7MNXdR+5c6JnzxRfwpz9B9+7Qq1fc
0YiIZFaqiaJ6YZIAcPfPzSxpVSN3HwWMKrLt1hL27ZRiLBm3ahUcfDDce2/ckYiIZF6qieJjM3uY
0IoA6EUlKgp4xBEweXK4LFZEpLJJ9aqnfsA84P+A64D5hNnZOW3ePLj6atiwQUlCRCqvpInCzA4G
OgMj3P0Mdz/d3e9y96yZILej/vQneOABWFHpyx+KSGWWrHrsjYTyHb2Ad8ysuJXuctLnn4crnPr3
D5PrREQqq2RjFL2AQ9z9BzNrQBiYfjz9YcVr40Y4/3zYbTe47rq4oxERiVeyRLHB3X8AcPdl0Wzq
nPeXv4S1r19+GRo2jDsaEZF4JUsU+yeslW1A88S1s929a9oii1GvXmFp0645+duJiJRNskRxdpHH
A9MVSEXSqlW42klERJKvmT02U4FUBOPGwaBBMHCgupxERAqlOuEu523ZArfcEuZO1KsXdzQiIhWH
EkXk2Wfhgw9g8GAtRiQikqhMVzGZWY10BRKndevgppvg8MOhb9+4oxERqVhSShRm1sHMpgNfRI/b
mdn9aY0sgwYOhIUL4e67oUqlnOcHAAAPFUlEQVSluABYRCR1qXY93QecRpiljbt/amYnpC2qDPv1
r2GPPaBTp7gjERGpeFL9/lzF3b8qsq2gvIOJy557qstJRKQkqSaKhWbWAXAzq2pmVwL/TWNcGZGf
D8ceC59+GnckIiIVV6qJoj9wFdAEWEJY37p/uoLKlNtugylTdDmsiEhpUhqjcPelhDWvc8bs2fDE
E3D55dC0adzRiIhUXCklCjN7BPCi29390nKPKENuuglq1Qo/RUSkZKle9TQm4X5N4CxgYfmHkxlT
psDw4fDHP0KDBnFHIyJSsaXa9fR84mMzexp4Jy0RZUC7dvDgg2HNCRERKd2OlvBoBuxXnoFkUvXq
0K9f3FGIiGSHVMcoVrJ1jKIKsAK4Pl1BpdP110PLlpo3ISKSqqSJwswMaAd8E23a4u7bDWxng0WL
4B//gMsuizsSEZHskXQeRZQURrh7QXTLyiQBcO+9UFAQLokVEZHUpDrhbrKZHZbWSNJs6VK4//6w
zGnz5nFHIyKSPUrtejKzau6+GTgWuMTM5gE/ENbPdnfPmuTx4IOwfj3cfHPckYiIZJdkYxSTgcOA
MzMQS1odeSTceCMccEDckYiIZJdkicIA3H1eBmJJq5NOCjcRESmbZImigZldVdKT7v7Pco6n3G3Z
EgaxzzsPfvrTuKMREck+yQazqwK1gTol3Cq8kSPh6qth7Ni4IxERyU7JWhSL3f32jESSJvfcA82a
QY8ecUciIpKdkrUoLCNRpMm8efD++3DJJVBtR4uViIhUcskSxS8yEkWaPPUUVKkCF1wQdyQiItmr
1ETh7it25uBm1tnM5pjZXDPbrjaUmV1lZrPM7DMzG2tm5Vpo8Ntv4eSToXHj8jyqiEjlkrYOGTOr
CgwCfgnkA1PMbKS7z0rY7RMgz93Xmll/4E6g3EYTBg0KVz2JiMiOS7WEx47oAMx19/nuvhEYBnRJ
3MHd33X3tdHDiUC5fff/9tvws0o6f0MRkUognR+jjdh2Fbz8aFtJ+gKji3vCzC41s6lmNnXZsmVJ
33j2bGjYMLQoRERk56QzURR3xVSxlWfN7HwgD7iruOfdfbC757l7XoMU1i595JHQkujWrSzhiohI
cdJ50Wg+sG/C48bAoqI7mdmJwE3Az9x9w86+6YYN8OST0KVLaFWIiMjOSWeLYgrQ0syamVl1oCcw
MnEHMzsUeBg4w92XlsebDhkCy5dD//7lcTQREUlboojKkw8A3gI+B15w95lmdruZnRHtdhehRMiL
ZjbNzEaWcLiU3XcfdOwIP//5zh5JREQgvV1PuPsoYFSRbbcm3D+xvN/zgw9Ci8Kyek65iEjFkXOF
LXbfPdxERKR85NQsg4sugpdeijsKEZHckjOJYvbsMJD9zTdxRyIikltyJlG89lr42bVrvHGIiOSa
nEkUr78O7drBvvsm31dERFKXE4li5UqYMAFOOy3uSEREck9OJIply6BTJzjjjKS7iohIGeXE5bGt
WsGYMXFHISKSm7K+RVFQECbYiYhIemR9ovjwQ9hrL7UoRETSJesTxRtvhJLiRxwRdyQiIrkp6xPF
66/D8cdDvXpxRyIikpuyOlEsWAAzZuiyWBGRdMrqRPHGG+GnEoWISPpk9eWxp58ONWtCy5ZxRyIi
kruyukXRpAn07Rt3FCIiuS1rE8VXX8Ezz8Dq1XFHIiKS27I2UbzyClxwQajzJCIi6ZO1iWLs2DA2
0bRp3JGIiOS2rEwU7jBxIhxzTNyRiIjkvqxMFF9+GSrGduwYdyQiIrkvKxPFxx+Hn0ceGW8cIiKV
QVbOo+jWDfLzoWHDuCMREcl9WZkoABo1ijsCEZHKIeu6ntyhZ0/44IO4IxERqRyyLlGsWwfPPw9L
lsQdiYhI5ZB1iWL9+vCzTZt44xARqSyyLlGsWwdVq0Lz5nFHIiJSOWRdotiwISSJ6tXjjkREpHLI
ukThDu3bxx2FiEjlkXWJonnzMJgtIiKZkXWJQkREMivrEsWcOfDRR3FHISJSeWRdovj+ezCLOwoR
kcoj6xIFwL77xh2BiEjlkdZEYWadzWyOmc01s+uLeb6GmT0fPT/JzJomPybUr5+OaEVEpDhpSxRm
VhUYBJwMtAHONbOi86n7AivdvQVwD3BHsuNWq6auJxGRTEpni6IDMNfd57v7RmAY0KXIPl2AJ6P7
LwG/MCs9DdSqVe5xiohIKdJZZrwRsDDhcT5QdE26H/dx981mthrYE/g2cSczuxS4NHq4wcxmpCXi
7FOfIueqEtO52ErnYiudi60O2NEXpjNRFNcy8B3YB3cfDAwGMLOp7p638+FlP52LrXQuttK52Ern
Yiszm7qjr01n11M+kHh9UmNgUUn7mFk1oB6wIo0xiYhIGaUzUUwBWppZMzOrDvQERhbZZyTQO7rf
Dfi3u2/XohARkfikrespGnMYALwFVAUed/eZZnY7MNXdRwKPAU+b2VxCS6JnCocenK6Ys5DOxVY6
F1vpXGylc7HVDp8L0xd4EREpTVbOzBYRkcxRohARkVJV2ESRjvIf2SqFc3GVmc0ys8/MbKyZ7RdH
nJmQ7Fwk7NfNzNzMcvbSyFTOhZmdE/1tzDSz5zIdY6ak8H+kiZm9a2afRP9PTokjznQzs8fNbGlJ
c80suC86T5+Z2WEpHdjdK9yNMPg9D9gfqA58CrQpss9vgYei+z2B5+OOO8ZzcQKwa3S/f2U+F9F+
dYD3gYlAXtxxx/h30RL4BNg9erxX3HHHeC4GA/2j+22ABXHHnaZzcTxwGDCjhOdPAUYT5rAdCUxK
5bgVtUWRlvIfWSrpuXD3d919bfRwImHOSi5K5e8C4E/AncD6TAaXYamci0uAQe6+EsDdl2Y4xkxJ
5Vw4UDe6X4/t53TlBHd/n9LnonUBnvJgIrCbme2d7LgVNVEUV/6jUUn7uPtmoLD8R65J5Vwk6kv4
xpCLkp4LMzsU2NfdX89kYDFI5e+iFdDKzCaY2UQz65yx6DIrlXNxG3C+meUDo4DLMxNahVPWzxMg
vSU8dka5lf/IASn/nmZ2PpAH/CytEcWn1HNhZlUIVYj7ZCqgGKXyd1GN0P3UidDKHG9mbd19VZpj
y7RUzsW5wBB3/4eZHUWYv9XW3bekP7wKZYc+Nytqi0LlP7ZK5VxgZicCNwFnuPuGDMWWacnORR2g
LTDOzBYQ+mBH5uiAdqr/R151903u/iUwh5A4ck0q56Iv8AKAu38I1CQUDKxsUvo8KaqiJgqV/9gq
6bmIulseJiSJXO2HhiTnwt1Xu3t9d2/q7k0J4zVnuPsOF0OrwFL5P/IK4UIHzKw+oStqfkajzIxU
zsXXwC8AzKw1IVEsy2iUFcNI4MLo6qcjgdXuvjjZiypk15Onr/xH1knxXNwF1AZejMbzv3b3M2IL
Ok1SPBeVQorn4i3gV2Y2CygArnX35fFFnR4pnourgUfM7PeErpY+ufjF0syGEroa60fjMX8AdgFw
94cI4zOnAHOBtcBFKR03B8+ViIiUo4ra9SQiIhWEEoWIiJRKiUJEREqlRCEiIqVSohARkVIpUUja
mFmBmU1LuDUtZd+mJVW8LON7jouqiH4ala44YAeO0c/MLozu9zGzfRKee9TM2pRznFPMrH0Kr7nS
zHbdgfe618yOL/K+hf8m3aLthf9WM8zsxcL3KbL9NTPbLdrewMzeLGsskp2UKCSd1rl7+4Tbggy9
by93b0coGnlXWV/s7g+5+1PRwz7APgnPXezus8olyq1xPkBqcV4JlClRmNkewJFRsbjE9y38N3kp
2lb4b9UW2Aj0K2b7CuAyAHdfBiw2s2PKEo9kJyUKyaio5TDezD6ObkcXs89BZjY5+ib7mZm1jLaf
n7D9YTOrmuTt3gdaRK/9hYW1CKZbqNlfI9r+d9u6lsfd0bbbzOya6Nt2HvBs9J4/ib6R55lZfzO7
MyHmPmZ2/w7G+SEJhdnM7EEzm2phDYk/RtuuICSsd83s3Wjbr8zsw+g8vmhmtYs5djegrN/8xxee
t9LiJMz87lXGY0sWUqKQdPpJQhfHiGjbUuCX7n4Y0AO4r5jX9QP+5e7tCR/U+VHZhR7AMdH2ApJ/
SJ0OTDezmsAQoIe7H0yoSNA/+rZ9FnCQux8C/DnxxdG37als/Qa+LuHpl4CuCY97AM/vYJydCR+6
hW5y9zzgEOBnZnaIu99HqMlzgrufYKEkx83AidG5nApcVcyxjwE+KrLt2YR/l20qLluom3YyML3I
9qqEEhiJs9+nAscl+d0kB1TIEh6SM9ZFH5aJdgEGRn3yBYT6Q0V9CNxkZo2B4e7+hZn9AjgcmBKV
KfkJIekU51kzWwcsIJSTPgD40t3/Gz3/JKELZSBhzYpHzewNIOXS5O6+zMzmW6iX80X0HhOi45Yl
zlqEshOJK42dY2aXEv5/7k1YaOezIq89Mto+IXqf6oTzVtTebF/TqFcx9a9+YmbTovvjCSVyErc3
JSScdxJes5SEbjnJXUoUkmm/B5YA7Qgt2u0WF3L358xsEnAq8JaZXUwoj/yku9+Qwnts80FY9Ftz
wvtsNrMOhG/KPYEBwM/L8Ls8D5wDzAZGuLtb+NROOU7Camx/BwYBXc2sGXANcIS7rzSzIYQCdkUZ
8I67n5vkPdaV8Prt9ismqf+43czqERLpZWxtBdaMji85Tl1Pkmn1gMXROgAXEL5Nb8PM9gfmR90t
IwldMGOBbma2V7TPHpb62uCzgaZmVtjvfgHwXtSnX8/dRxEGiov7oFxDKF9enOHAmYS1Dp6PtpUp
TnffROhCOjLqtqoL/ACsNrOGhG6g4mKZCBxT+DuZ2a5mVlzr7HOKH28oE3dfDVwBXGNmu0SbWwE7
faWaVHxKFJJpDwC9zWwi4YPmh2L26QHMiLo8DiQs3TiL8IH6tpl9RugCSbqEI4C7rydUyXzRzKYD
W4CHCB+6r0fHe4/Q2ilqCPBQ4WB2keOuBGYB+7n75GhbmeOMxj7+AVzj7p8S1rmeCTxO6M4qNBgY
bWbvRlcd9QGGRu8zkXCuinqDUE10p7n7J4QWUGGl5hOi40uOU/VYkRxnZh8Ap5X3ynZm9j7QpXBN
bsldShQiOc7MOhLGGooOiO/MMRsQrux6JenOkvWUKEREpFQaoxARkVIpUYiISKmUKEREpFRKFCIi
UiolChERKdX/AxRMMCrOK7FzAAAAAElFTkSuQmCC
"
>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[104]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">confusion_matrix</span><span class="p">()</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21708051286464972:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>83212.0</td>
<td>23869.0</td>
<td>0.2229</td>
<td> (23869.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9376.0</td>
<td>14498.0</td>
<td>0.3927</td>
<td> (9376.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>92588.0</td>
<td>38367.0</td>
<td>0.2539</td>
<td> (33245.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[104]:</div>
<div class="output_text output_subarea output_execute_result">
<pre></pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[105]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">roc</span><span class="o">=</span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">roc</span><span class="p">()</span>
<span class="n">roc</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt output_prompt">Out[105]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>([0.0,
0.0,
0.0,
0.0,
0.0,
9.33872489050345e-06,
9.33872489050345e-06,
2.8016174671510353e-05,
4.669362445251725e-05,
5.6032349343020706e-05,
9.33872489050345e-05,
0.00011206469868604141,
0.0001307421484670483,
0.00016809704802906212,
0.00023346812226258625,
0.0002988391964961104,
0.0003922264454011449,
0.00044825879474416565,
0.0005229685938681932,
0.000579000943211214,
0.0006256945676637312,
0.0007097430916782623,
0.0008031303405832968,
0.0008871788645978278,
0.0009805661135028623,
0.0011019695370794072,
0.0012046955108749452,
0.0012794053099989728,
0.001344776384232497,
0.0014475023580280348,
0.0015782445064950832,
0.001680970480290621,
0.0018584062532101867,
0.0020358420261297524,
0.0021665841745968006,
0.0022879875981733455,
0.0023720361221878767,
0.0025307944453264353,
0.002689552768464994,
0.002857649816494056,
0.003063101764085132,
0.0032405375370046976,
0.003558054183281815,
0.003791522305544401,
0.00400631297802598,
0.004258458550069574,
0.004547959021675181,
0.004893491842623808,
0.005117621239995891,
0.005453815336054015,
0.005799348157002643,
0.006051493729046236,
0.006397026549994864,
0.006686527021600471,
0.007041398567439602,
0.007424286287950243,
0.007536350986636285,
0.007909899982256424,
0.008330142602329078,
0.008703691597949216,
0.009123934218021872,
0.00955351556298503,
0.009917725833714664,
0.010263258654663293,
0.01072085617429796,
0.01085159832276501,
0.01120646986860414,
0.011626712488676796,
0.012168358532325996,
0.012401826654588582,
0.01287810162400426,
0.0132609893445149,
0.013625199615244535,
0.0138026353881641,
0.014456346130499342,
0.01477386277677646,
0.015212782846630121,
0.01572641271560781,
0.01628673620903802,
0.016529543056191108,
0.017127221449183327,
0.017603496418599006,
0.018145142462248205,
0.018313239510277267,
0.01889224045348848,
0.019387192872685165,
0.019816774217648322,
0.020349081536407018,
0.020769324156479675,
0.021254937850785853,
0.02178724516954455,
0.022496988261222813,
0.023225408802682083,
0.02389779699479833,
0.024243329815746957,
0.024803653309177165,
0.025326621903045358,
0.025933639020928084,
0.02640991399034376,
0.027082302182460008,
0.02782006144880978,
0.028408401116911498,
0.029276902531728318,
0.030033339247859097,
0.03077109851420887,
0.031518196505449146,
0.032358681745594454,
0.033068424837272715,
0.03366610323026494,
0.0343758463219432,
0.03509492813851197,
0.035711283981285195,
0.035982107003109796,
0.0368039147934741,
0.037494980435371354,
0.03806464265369206,
0.03876504702047982,
0.039577516085953626,
0.040455356225660946,
0.041286502740915755,
0.04230442375398063,
0.04335969966660752,
0.043929361884928235,
0.04503133142200764,
0.04589983283682446,
0.046693624452517256,
0.04754344841755307,
0.048402611107479385,
0.04940185467076325,
0.050298372260251585,
0.05110150260083488,
0.05202603636499473,
0.05288519905492104,
0.05340816764878924,
0.05437939503740159,
0.05537863860068546,
0.056424575788421846,
0.057218367404114644,
0.05832033694119405,
0.05908611238221533,
0.06037485641710481,
0.061803681325351835,
0.06276556998907369,
0.06405431402396317,
0.06506289631213755,
0.06606213987542141,
0.06743493243432541,
0.06785517505439807,
0.06905053184038251,
0.07018985627702394,
0.07082488956957816,
0.07188016548220506,
0.073047506093518,
0.07407476583147338,
0.07521409026811479,
0.07639076960431823,
0.07763282001475519,
0.07832388565665244,
0.07960329096665142,
0.08105079332467945,
0.08187260111504376,
0.08297457065212316,
0.08421662106256012,
0.08515049355161046,
0.0866166733594195,
0.08827896638992912,
0.08962374277416162,
0.09083777700992707,
0.09220123084394057,
0.09357402340284457,
0.09505888066043462,
0.09646902811890065,
0.0979912402760527,
0.09945742008386176,
0.10049401854670763,
0.1017547464069256,
0.10317423259028212,
0.1044723153500621,
0.10593849515787114,
0.10753541711414723,
0.10908564544597081,
0.11065455122757539,
0.11293320010085822,
0.1147542514545064,
0.11632315723611099,
0.1179667728168396,
0.11959171094778719,
0.12121664907873479,
0.12291629700880642,
0.12363537882537519,
0.12525097823143228,
0.12702533596062793,
0.12906117798675767,
0.13066743866792427,
0.1323857640477769,
0.13414144432719158,
0.13600918930529227,
0.13778354703448792,
0.13955790476368357,
0.14108011692083564,
0.14295720062382683,
0.14510510734864263,
0.14703822340097683,
0.1491207590515591,
0.15137139175017042,
0.15327649162783313,
0.15515357533082433,
0.15689991688534846,
0.15868361333943462,
0.16039259999439676,
0.16310083021264277,
0.16551022123439266,
0.16764878923431795,
0.1699647930071628,
0.17145898898964335,
0.17334541141752505,
0.1753812534436548,
0.17756651506803262,
0.17949029239547631,
0.18143274717270105,
0.18338454067481627,
0.18549509250007004,
0.18736283747817073,
0.18926793735583344,
0.1916212960282403,
0.19307813711115884,
0.19529141491020816,
0.1975420476088195,
0.1997646641327593,
0.20199661938158964,
0.20434997805399652,
0.2059469000102726,
0.2083749684818035,
0.21084973057778691,
0.21316573435063177,
0.2157152062457392,
0.21818062961683213,
0.22035655251631941,
0.22290602441142687,
0.22610920704886955,
0.2292376798871882,
0.23176847433251463,
0.23457009179966568,
0.2373903867165977,
0.2403227463322158,
0.2430216378255713,
0.24567383569447426,
0.24723340275118835,
0.2500256814934489,
0.25297671855884796,
0.255740981126437,
0.258430533894902,
0.2614095871349726,
0.2642112046021236,
0.2670221607941652,
0.26999187530934526,
0.2719997011608035,
0.2749974318506551,
0.2784060664356889,
0.28237502451415286,
0.28546614245290947,
0.2884918893174326,
0.2914242489330507,
0.2946647864700554,
0.29756912991100193,
0.30060421550041555,
0.30380739813785823,
0.30697322587573894,
0.3108954903297504,
0.3138838822947115,
0.3171804521810592,
0.3204770220674069,
0.3237922694035356,
0.3275744529841895,
0.3293021170889327,
0.3325800095254994,
0.3360353377349857,
0.3403498286343983,
0.34413201221505213,
0.3475780016996479,
0.3511267171580392,
0.35575872470372893,
0.35985842493065995,
0.3632577207908032,
0.3668064362491945,
0.37149447614422726,
0.3762105322139315,
0.3801608128426145,
0.38395233514815885,
0.3887431010169871,
0.3926280105714366,
0.3966903558988056,
0.40118228257113775,
0.407289808649527,
0.41139884760134854,
0.4155359027278415,
0.419476844631634,
0.42529487023841767,
0.4292544895919911,
0.43314873787133107,
0.4371457121244665,
0.44103062167891594,
0.44697938943416665,
0.45131255778336027,
0.45561770995788237,
0.4595493131367843,
0.464031901084226,
0.4684211017827626,
0.47288501228042323,
0.47761040707501795,
0.48214902737180265,
0.488555392646688,
0.4941212726814281,
0.49882799002624184,
0.5046646930828065,
0.5091192648555766,
0.5149839840868128,
0.5197373950560791,
0.5243507251519878,
0.529048103771911,
0.5334466431953381,
0.5404973804876683,
0.5451200493084675,
0.5500602347755438,
0.5548790168190435,
0.5595577179891857,
0.5667485361548734,
0.5715206245739207,
0.5767129556130406,
0.5829325463901159,
0.5892735405907678,
0.5944565329049971,
0.5996955575685696,
0.6049439209570325,
0.6111821891838888,
0.6159916325024981,
0.6218096581092818,
0.6269926504235112,
0.6324371270346747,
0.6392263800300707,
0.6472483447110131,
0.6564469887281591,
0.6622743530598332,
0.6674013130247196,
0.6740224689720865,
0.6818296429805475,
0.6880585724825132,
0.6919248045871816,
0.6972105228752066,
0.7026176445868081,
0.7106676254424221,
0.7176716691102997,
0.7231161457214632,
0.7317077726207264,
0.7390853652842241,
0.7450808266639273,
0.7504132385764047,
0.7560911833098308,
0.7630298559034749,
0.7687358168115725,
0.7760573771257272,
0.782267629177912,
0.7881603645838198,
0.7940157450901654,
0.7994228668017669,
0.8062401359718344,
0.8134402928624126,
0.8217424192900701,
0.8287838178575098,
0.8343123429926877,
0.8395513676562603,
0.8448370859442852,
0.8530925187474903,
0.8600498687909153,
0.8668671379609828,
0.8699769333495204,
0.8768035412444785,
0.882229340405861,
0.8880100111130826,
0.8963214762656307,
0.9017939690514657,
0.9071077035141621,
0.9127669707978072,
0.9204807575573631,
0.9262987831641468,
0.9325930837403461,
0.937897479478152,
0.9431551815915055,
0.9474696724909181,
0.9537639730671175,
0.9591617560538284,
0.967557269730391,
0.9740476835292909,
0.9785863038260756,
0.9817894864635183,
0.9877382542187689,
0.9927718269347503,
0.9959002997730689,
0.9989634015371541,
1.0],
[8.377314233056883e-05,
0.00016754628466113765,
0.0004607522828181285,
0.0007539582809751194,
0.001130937421462679,
0.0014660299907849543,
0.0019267822736030828,
0.002345647985255927,
0.0029320599815699086,
0.003769791404875597,
0.004691295970511854,
0.005361481109156405,
0.006408645388288514,
0.006995057384602496,
0.007832788807908185,
0.008670520231213872,
0.01026220993549468,
0.011435033928122644,
0.012105219066767195,
0.01357124905755215,
0.0155818044734858,
0.016838401608444332,
0.017885565887576442,
0.018765183882047416,
0.0201474407305018,
0.020943285582642204,
0.022241769288766023,
0.02366591270838569,
0.024419870989360812,
0.026137220407137472,
0.027770796682583563,
0.029613805813856076,
0.031121722375806318,
0.03292284493591355,
0.034346988355533216,
0.03543603920583061,
0.03690206919661557,
0.03866130518555751,
0.0408394068861523,
0.042808075730920665,
0.04532127000083773,
0.047289938845606096,
0.04946804054620089,
0.051604255675630394,
0.05336349166457234,
0.05545782022283656,
0.05771969506576192,
0.06027477590684427,
0.06249476417860434,
0.0647566390215297,
0.06794001843009131,
0.07016000670185138,
0.07288263382759487,
0.07443243696071039,
0.07610789980732177,
0.07803468208092486,
0.07908184636005697,
0.08159504062997402,
0.08406634832872581,
0.08657954259864288,
0.08988858172070034,
0.09185725056546871,
0.0940353522660635,
0.0969674122476334,
0.09943871994638519,
0.10094663650833542,
0.1034179442070872,
0.10563793247884729,
0.1080254670352685,
0.1093658373125576,
0.11238167043645807,
0.11443411242355701,
0.11669598726648236,
0.1179525844014409,
0.12071709809834967,
0.12201558180447349,
0.12486386864371282,
0.1273351763424646,
0.12972271089888582,
0.13148194688782777,
0.133576275446092,
0.1365083354276619,
0.13881209684175252,
0.14015246711904164,
0.14287509424478512,
0.14538828851470217,
0.1485716679232638,
0.15112674876434615,
0.15351428332076736,
0.15657200301583313,
0.1590014241434196,
0.16205914383848538,
0.16482365753539416,
0.16746251151880706,
0.16934740722124486,
0.17144173577950908,
0.17449945547457485,
0.17755717516964062,
0.18053112172237581,
0.18249979056714416,
0.18501298483706125,
0.1867303342548379,
0.1905001256597135,
0.1931389796431264,
0.19590349334003518,
0.1987936667504398,
0.20051101616821648,
0.20356873586328222,
0.2058306107062076,
0.2087207841166122,
0.21161095752701684,
0.2141241517969339,
0.2154226355030577,
0.21848035519812348,
0.2216637346066851,
0.22426070201893272,
0.22681578286001508,
0.22983161598391555,
0.23226103711150206,
0.23494177766608026,
0.23858590935746,
0.24164362905252576,
0.24323531875680657,
0.247130769875178,
0.2504398089972355,
0.2536650749769624,
0.25601072296221833,
0.25860769037446596,
0.26262880120633325,
0.26539331490324203,
0.26773896288849797,
0.27062913629890256,
0.2742732679902823,
0.27599061740805897,
0.2787132445338025,
0.2822317165116863,
0.2849962302085951,
0.2877188573343386,
0.29060903074474326,
0.2926614727318422,
0.2963893775655525,
0.29999162268576696,
0.3032587752366591,
0.3065678143587166,
0.3092066683421295,
0.31247382089302167,
0.316494931724889,
0.31796096171567395,
0.32059981569908685,
0.3239507413923096,
0.3251235653849376,
0.32868392393398677,
0.33216050934070535,
0.33513445589344054,
0.33831783530200216,
0.34137555499706795,
0.3440981821228114,
0.3455223255424311,
0.34891513780681915,
0.3519309709307196,
0.35339700092150456,
0.3570411326128843,
0.3603082851637765,
0.36344977800117284,
0.36633995141157744,
0.37006785624528776,
0.3734606685096758,
0.37647650163357627,
0.3793247884728156,
0.3830526933065259,
0.3859009801457653,
0.3884141744156823,
0.3915137806819134,
0.39457150037697913,
0.3970009215045656,
0.40014241434196196,
0.40345145346401945,
0.40655105973025046,
0.4101533048504649,
0.41333668425902653,
0.4165619502387535,
0.41982910278964564,
0.4239758733350088,
0.4277875513110497,
0.4305939515791237,
0.43352601156069365,
0.43708637010974283,
0.4403116360894697,
0.4433274692133702,
0.4451285917734774,
0.4483538577532043,
0.4515372371617659,
0.4551813688531457,
0.45849040797520313,
0.4621764262377482,
0.4653179190751445,
0.46896205076652425,
0.47273184217139985,
0.4758314484376309,
0.47834464270754795,
0.48165368182960544,
0.4850046075228282,
0.48781100779090225,
0.4919158917651001,
0.49660718773561197,
0.5,
0.5036022451202145,
0.5062829856747927,
0.5097595710815113,
0.512817290776577,
0.5172991538912625,
0.5211108318673033,
0.5241685515623691,
0.5276032503979224,
0.529907011812013,
0.5330485046494094,
0.5363994303426322,
0.5394990366088632,
0.5428080757309207,
0.5459914551394823,
0.5491329479768786,
0.5520231213872833,
0.5555834799363324,
0.5590181787718858,
0.5626623104632654,
0.5645472061657033,
0.567604925860769,
0.5713747172656446,
0.5746837563877021,
0.577322610371115,
0.5805478763508419,
0.5828516377649325,
0.5866633157409734,
0.5903912205746837,
0.5935745999832454,
0.5970511853899639,
0.6006115439390132,
0.6037949233475748,
0.6072715087542934,
0.6114182792996565,
0.6151461841333669,
0.6184971098265896,
0.6222250146602999,
0.6263298986344977,
0.6299740303258775,
0.6334925023037614,
0.6377649325626205,
0.6393985088380665,
0.6417860433944877,
0.6446343302337271,
0.6486554410655944,
0.6520482533299824,
0.6548127670268912,
0.6582474658624445,
0.6618078244114937,
0.6645723381084024,
0.667588171232303,
0.6707296640696992,
0.674373795761079,
0.6785205663064422,
0.6817877188573344,
0.6856412834045406,
0.6889922090977633,
0.6928038870738041,
0.696615565049845,
0.6997989444584066,
0.7028147775823071,
0.7062075898466952,
0.7108569992460417,
0.7145011309374215,
0.7170980983496691,
0.7205327971852225,
0.7239256094496105,
0.7282399262796347,
0.7305436876937254,
0.7336432939599564,
0.7363659210856999,
0.7409734439138812,
0.7440730501801123,
0.7481779341543101,
0.7512356538493759,
0.7556337438217308,
0.759654854653598,
0.762880120633325,
0.7656027477590684,
0.7690374465946218,
0.7733936499958114,
0.777330987685348,
0.7801373879534221,
0.7847449107816035,
0.7881377230459915,
0.7906928038870739,
0.794253162436123,
0.7990701181201307,
0.8015833123900478,
0.8044315992292871,
0.8074474323531876,
0.8113847700427244,
0.8147775823071124,
0.8177934154310128,
0.8205998156990869,
0.8244114936751278,
0.8280556253665075,
0.8309039122057469,
0.8336265393314903,
0.8360559604590768,
0.8392812264388038,
0.8417525341375555,
0.8448940269749519,
0.8482868392393399,
0.8508419200804223,
0.8546535980564631,
0.8582139566055123,
0.8609365837312558,
0.8644131691379744,
0.8674708888330401,
0.8704867219569407,
0.8732512356538493,
0.87555499706794,
0.8784451704783447,
0.88070704532127,
0.8846024964396415,
0.887031917567228,
0.8895869984083103,
0.8918069866800704,
0.8940269749518305,
0.8978805394990366,
0.8999329814861355,
0.9026137220407138,
0.905587668593449,
0.9085197285750188,
0.9111166959872665,
0.9133785708301918,
0.9155147859596213,
0.9182374130853649,
0.9203736282147943,
0.9225936164865544,
0.9243947390466617,
0.9264052944625953,
0.9289184887325124,
0.9317248890005864,
0.9355365669766273,
0.9374214626790651,
0.9396414509508252,
0.9419033257937506,
0.9445421797771635,
0.9474742397587333,
0.9486470637513613,
0.9507413923096255,
0.9526262880120633,
0.9556421211359638,
0.9577783362653933,
0.9601239842506493,
0.9626371785205663,
0.9648990533634917,
0.9664488564966072,
0.9683337521990449,
0.970092988187987,
0.9719778838904247,
0.9729412750272263,
0.9745329647315071,
0.9757476752953004,
0.9769204992879283,
0.978051436709391,
0.97939180698668,
0.9804389712658121,
0.9819887743989277,
0.9837480103878696,
0.9854653598056463,
0.986596297227109,
0.987643461506241,
0.988523079500712,
0.9895702437798441,
0.9903660886319846,
0.9916226857669431,
0.992041551478596,
0.9931724889000586,
0.9937589008963726,
0.9946385188908436,
0.9953505906006535,
0.9959788891681327,
0.9964396414509509,
0.9970260534472648,
0.9976962385859094,
0.9980732177263969,
0.9985339700092151,
0.998827176007372,
0.9991622685766943,
0.9992041551478597,
0.9994135880036861,
0.9996649074306777,
0.9997905671441736,
0.9998743402865041,
0.9999581134288347,
1.0,
1.0,
1.0,
1.0,
1.0,
1.0])</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[106]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">tnr</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Model Details
=============
H2OStackedEnsembleEstimator : Stacked Ensemble
Model Key: StackedEnsemble_AllModels_0_AutoML_20181120_154205
No model summary for this model
ModelMetricsBinomialGLM: stackedensemble
** Reported on train data. **
MSE: 0.12685990330985406
RMSE: 0.3561739789904002
LogLoss: 0.40703958453227496
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124374.13927893189
Residual deviance: 106607.73758484815
AIC: 106631.73758484815
AUC: 0.7734040182726795
Gini: 0.5468080365453589
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21708051286464972:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>83212.0</td>
<td>23869.0</td>
<td>0.2229</td>
<td> (23869.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9376.0</td>
<td>14498.0</td>
<td>0.3927</td>
<td> (9376.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>92588.0</td>
<td>38367.0</td>
<td>0.2539</td>
<td> (33245.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.2170805</td>
<td>0.4658666</td>
<td>238.0</td></tr>
<tr><td>max f2</td>
<td>0.1410190</td>
<td>0.6067433</td>
<td>309.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3338429</td>
<td>0.4568693</td>
<td>155.0</td></tr>
<tr><td>max accuracy</td>
<td>0.4390853</td>
<td>0.8290100</td>
<td>98.0</td></tr>
<tr><td>max precision</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0676438</td>
<td>1.0</td>
<td>394.0</td></tr>
<tr><td>max specificity</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2335835</td>
<td>0.3269004</td>
<td>224.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1855661</td>
<td>0.6993958</td>
<td>265.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1761337</td>
<td>0.7006208</td>
<td>274.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5809896</td>
<td>4.2290904</td>
<td>4.2290904</td>
<td>0.7709924</td>
<td>0.7709924</td>
<td>0.0423054</td>
<td>0.0423054</td>
<td>322.9090447</td>
<td>322.9090447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5350310</td>
<td>3.4879528</td>
<td>3.8585216</td>
<td>0.6358779</td>
<td>0.7034351</td>
<td>0.0348915</td>
<td>0.0771970</td>
<td>248.7952815</td>
<td>285.8521631</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.5007744</td>
<td>3.1972882</td>
<td>3.6382227</td>
<td>0.5828877</td>
<td>0.6632731</td>
<td>0.0319595</td>
<td>0.1091564</td>
<td>219.7288214</td>
<td>263.8222689</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4718430</td>
<td>2.9436144</td>
<td>3.4645375</td>
<td>0.5366412</td>
<td>0.6316091</td>
<td>0.0294463</td>
<td>0.1386027</td>
<td>194.3614440</td>
<td>246.4537481</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4483865</td>
<td>2.8704357</td>
<td>3.3457716</td>
<td>0.5233002</td>
<td>0.6099572</td>
<td>0.0286923</td>
<td>0.1672950</td>
<td>187.0435684</td>
<td>234.5771560</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3623038</td>
<td>2.4444070</td>
<td>2.8950893</td>
<td>0.4456323</td>
<td>0.5277947</td>
<td>0.1222250</td>
<td>0.2895200</td>
<td>144.4406963</td>
<td>189.5089261</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.3079302</td>
<td>1.9878608</td>
<td>2.5926798</td>
<td>0.3624007</td>
<td>0.4726634</td>
<td>0.0993968</td>
<td>0.3889168</td>
<td>98.7860769</td>
<td>159.2679764</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2684456</td>
<td>1.7116814</td>
<td>2.3724554</td>
<td>0.3120513</td>
<td>0.4325150</td>
<td>0.0855743</td>
<td>0.4744911</td>
<td>71.1681359</td>
<td>137.2455391</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2132009</td>
<td>1.4102670</td>
<td>2.0517178</td>
<td>0.2571014</td>
<td>0.3740423</td>
<td>0.1410321</td>
<td>0.6155232</td>
<td>41.0267006</td>
<td>105.1717765</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1765625</td>
<td>1.1217652</td>
<td>1.8192385</td>
<td>0.2045055</td>
<td>0.3316597</td>
<td>0.1121722</td>
<td>0.7276954</td>
<td>12.1765206</td>
<td>81.9238502</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1503145</td>
<td>0.8745582</td>
<td>1.6302967</td>
<td>0.1594380</td>
<td>0.2972143</td>
<td>0.0874592</td>
<td>0.8151546</td>
<td>-12.5441786</td>
<td>63.0296674</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1300345</td>
<td>0.6769128</td>
<td>1.4714054</td>
<td>0.1234059</td>
<td>0.2682474</td>
<td>0.0676887</td>
<td>0.8828433</td>
<td>-32.3087165</td>
<td>47.1405434</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1129563</td>
<td>0.4959559</td>
<td>1.3320601</td>
<td>0.0904162</td>
<td>0.2428437</td>
<td>0.0495937</td>
<td>0.9324370</td>
<td>-50.4044061</td>
<td>33.2060067</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0978849</td>
<td>0.3920433</td>
<td>1.2145535</td>
<td>0.0714722</td>
<td>0.2214215</td>
<td>0.0392058</td>
<td>0.9716428</td>
<td>-60.7956663</td>
<td>21.4553489</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0824531</td>
<td>0.2194940</td>
<td>1.1039951</td>
<td>0.0400153</td>
<td>0.2012659</td>
<td>0.0219486</td>
<td>0.9935914</td>
<td>-78.0505987</td>
<td>10.3995078</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597755</td>
<td>0.0640840</td>
<td>1.0</td>
<td>0.0116830</td>
<td>0.1823069</td>
<td>0.0064086</td>
<td>1.0</td>
<td>-93.5915993</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on validation data. **
MSE: 0.13813682407268132
RMSE: 0.37166762580655494
LogLoss: 0.4379927029517987
Null degrees of freedom: 33031
Residual degrees of freedom: 33020
Null deviance: 31732.354674481932
Residual deviance: 28935.54992780763
AIC: 28959.54992780763
AUC: 0.7122628231156057
Gini: 0.4245256462312115
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.18933454821029921:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>18652.0</td>
<td>8238.0</td>
<td>0.3064</td>
<td> (8238.0/26890.0)</td></tr>
<tr><td>1</td>
<td>2386.0</td>
<td>3756.0</td>
<td>0.3885</td>
<td> (2386.0/6142.0)</td></tr>
<tr><td>Total</td>
<td>21038.0</td>
<td>11994.0</td>
<td>0.3216</td>
<td> (10624.0/33032.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1893345</td>
<td>0.4142038</td>
<td>256.0</td></tr>
<tr><td>max f2</td>
<td>0.1197407</td>
<td>0.5738535</td>
<td>330.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3129965</td>
<td>0.3817812</td>
<td>160.0</td></tr>
<tr><td>max accuracy</td>
<td>0.6010242</td>
<td>0.8160572</td>
<td>29.0</td></tr>
<tr><td>max precision</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0640080</td>
<td>1.0</td>
<td>398.0</td></tr>
<tr><td>max specificity</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2092723</td>
<td>0.2475688</td>
<td>238.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1762849</td>
<td>0.6525562</td>
<td>268.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1577331</td>
<td>0.6547886</td>
<td>286.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.59 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100206</td>
<td>0.5783690</td>
<td>3.1358434</td>
<td>3.1358434</td>
<td>0.5830816</td>
<td>0.5830816</td>
<td>0.0314230</td>
<td>0.0314230</td>
<td>213.5843447</td>
<td>213.5843447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200109</td>
<td>0.5293169</td>
<td>2.5749465</td>
<td>2.8558192</td>
<td>0.4787879</td>
<td>0.5310136</td>
<td>0.0257245</td>
<td>0.0571475</td>
<td>157.4946469</td>
<td>185.5819237</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300012</td>
<td>0.4955180</td>
<td>2.4119752</td>
<td>2.7080205</td>
<td>0.4484848</td>
<td>0.5035318</td>
<td>0.0240964</td>
<td>0.0812439</td>
<td>141.1975173</td>
<td>170.8020508</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400218</td>
<td>0.4688250</td>
<td>2.4859277</td>
<td>2.6524133</td>
<td>0.4622356</td>
<td>0.4931921</td>
<td>0.0249105</td>
<td>0.1061543</td>
<td>148.5927707</td>
<td>165.2413309</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500121</td>
<td>0.4455599</td>
<td>2.2164096</td>
<td>2.5653181</td>
<td>0.4121212</td>
<td>0.4769976</td>
<td>0.0221426</td>
<td>0.1282970</td>
<td>121.6409619</td>
<td>156.5318141</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000242</td>
<td>0.3612868</td>
<td>2.0607188</td>
<td>2.3130185</td>
<td>0.3831719</td>
<td>0.4300847</td>
<td>0.1030609</td>
<td>0.2313579</td>
<td>106.0718760</td>
<td>131.3018450</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500061</td>
<td>0.3068785</td>
<td>1.7850835</td>
<td>2.1371112</td>
<td>0.3319200</td>
<td>0.3973764</td>
<td>0.0892218</td>
<td>0.3205796</td>
<td>78.5083530</td>
<td>113.7111174</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2000182</td>
<td>0.2675737</td>
<td>1.5756523</td>
<td>1.9967252</td>
<td>0.2929782</td>
<td>0.3712729</td>
<td>0.0788017</td>
<td>0.3993813</td>
<td>57.5652259</td>
<td>99.6725200</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000121</td>
<td>0.2132448</td>
<td>1.3758567</td>
<td>1.7897899</td>
<td>0.2558280</td>
<td>0.3327952</td>
<td>0.1375773</td>
<td>0.5369586</td>
<td>37.5856668</td>
<td>78.9789907</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4000061</td>
<td>0.1764937</td>
<td>1.1299935</td>
<td>1.6248533</td>
<td>0.2101120</td>
<td>0.3021267</td>
<td>0.1129925</td>
<td>0.6499512</td>
<td>12.9993524</td>
<td>62.4853295</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5</td>
<td>0.1497263</td>
<td>0.9964784</td>
<td>1.4991859</td>
<td>0.1852861</td>
<td>0.2787600</td>
<td>0.0996418</td>
<td>0.7495930</td>
<td>-0.3521561</td>
<td>49.9185933</td></tr>
<tr><td></td>
<td>12</td>
<td>0.5999939</td>
<td>0.1296393</td>
<td>0.7587565</td>
<td>1.3757872</td>
<td>0.1410839</td>
<td>0.2558151</td>
<td>0.0758711</td>
<td>0.8254640</td>
<td>-24.1243542</td>
<td>37.5787247</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999879</td>
<td>0.1130667</td>
<td>0.6284978</td>
<td>1.2690362</td>
<td>0.1168635</td>
<td>0.2359657</td>
<td>0.0628460</td>
<td>0.8883100</td>
<td>-37.1502161</td>
<td>26.9036234</td></tr>
<tr><td></td>
<td>14</td>
<td>0.7999818</td>
<td>0.0982229</td>
<td>0.5259192</td>
<td>1.1761501</td>
<td>0.0977899</td>
<td>0.2186944</td>
<td>0.0525887</td>
<td>0.9408987</td>
<td>-47.4080824</td>
<td>17.6150117</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999758</td>
<td>0.0826149</td>
<td>0.3989170</td>
<td>1.0897938</td>
<td>0.0741750</td>
<td>0.2026372</td>
<td>0.0398893</td>
<td>0.9807880</td>
<td>-60.1082978</td>
<td>8.9793790</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0605773</td>
<td>0.1920733</td>
<td>1.0</td>
<td>0.0357143</td>
<td>0.1859409</td>
<td>0.0192120</td>
<td>1.0</td>
<td>-80.7926687</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on cross-validation data. **
MSE: 0.1369765435568584
RMSE: 0.3701034227845757
LogLoss: 0.4355309009590542
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124375.46514588114
Residual deviance: 114069.89827018589
AIC: 114093.89827018589
AUC: 0.7071203432205223
Gini: 0.4142406864410446
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.17843972441369682:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>73561.0</td>
<td>33520.0</td>
<td>0.313</td>
<td> (33520.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9215.0</td>
<td>14659.0</td>
<td>0.386</td>
<td> (9215.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>82776.0</td>
<td>48179.0</td>
<td>0.3263</td>
<td> (42735.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1784397</td>
<td>0.4068949</td>
<td>261.0</td></tr>
<tr><td>max f2</td>
<td>0.1136746</td>
<td>0.5665672</td>
<td>334.0</td></tr>
<tr><td>max f0point5</td>
<td>0.2879939</td>
<td>0.3708050</td>
<td>176.0</td></tr>
<tr><td>max accuracy</td>
<td>0.5663591</td>
<td>0.8184567</td>
<td>36.0</td></tr>
<tr><td>max precision</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0620870</td>
<td>1.0</td>
<td>399.0</td></tr>
<tr><td>max specificity</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.1815977</td>
<td>0.2412252</td>
<td>258.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1671726</td>
<td>0.6498819</td>
<td>272.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1616542</td>
<td>0.6512829</td>
<td>278.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5609815</td>
<td>2.9394272</td>
<td>2.9394272</td>
<td>0.5358779</td>
<td>0.5358779</td>
<td>0.0294044</td>
<td>0.0294044</td>
<td>193.9427222</td>
<td>193.9427222</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5136764</td>
<td>2.6044498</td>
<td>2.7719385</td>
<td>0.4748092</td>
<td>0.5053435</td>
<td>0.0260534</td>
<td>0.0554578</td>
<td>160.4449761</td>
<td>177.1938491</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.4802174</td>
<td>2.4346323</td>
<td>2.6595603</td>
<td>0.4438503</td>
<td>0.4848562</td>
<td>0.0243361</td>
<td>0.0797939</td>
<td>143.4632310</td>
<td>165.9560331</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4541967</td>
<td>2.2987828</td>
<td>2.5693487</td>
<td>0.4190840</td>
<td>0.4684100</td>
<td>0.0229957</td>
<td>0.1027896</td>
<td>129.8782827</td>
<td>156.9348739</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4304407</td>
<td>2.3592048</td>
<td>2.5273392</td>
<td>0.4300993</td>
<td>0.4607514</td>
<td>0.0235821</td>
<td>0.1263718</td>
<td>135.9204803</td>
<td>152.7339208</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3489922</td>
<td>2.0674422</td>
<td>2.2973907</td>
<td>0.3769090</td>
<td>0.4188302</td>
<td>0.1033761</td>
<td>0.2297478</td>
<td>106.7442216</td>
<td>129.7390712</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.2957391</td>
<td>1.7583311</td>
<td>2.1177042</td>
<td>0.3205559</td>
<td>0.3860721</td>
<td>0.0879199</td>
<td>0.3176678</td>
<td>75.8331123</td>
<td>111.7704182</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2569097</td>
<td>1.5826559</td>
<td>1.9839574</td>
<td>0.2885291</td>
<td>0.3616891</td>
<td>0.0791237</td>
<td>0.3967915</td>
<td>58.2655941</td>
<td>98.3957443</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2032167</td>
<td>1.3679632</td>
<td>1.7786208</td>
<td>0.2493891</td>
<td>0.3242548</td>
<td>0.1368015</td>
<td>0.5335930</td>
<td>36.7963184</td>
<td>77.8620797</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1679941</td>
<td>1.1284673</td>
<td>1.6160886</td>
<td>0.2057274</td>
<td>0.2946241</td>
<td>0.1128424</td>
<td>0.6464355</td>
<td>12.8467313</td>
<td>61.6088632</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1428590</td>
<td>0.9302652</td>
<td>1.4789198</td>
<td>0.1695938</td>
<td>0.2696173</td>
<td>0.0930301</td>
<td>0.7394655</td>
<td>-6.9734773</td>
<td>47.8919761</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1238863</td>
<td>0.8143060</td>
<td>1.3681550</td>
<td>0.1484536</td>
<td>0.2494241</td>
<td>0.0814275</td>
<td>0.8208930</td>
<td>-18.5693965</td>
<td>36.8155036</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1081113</td>
<td>0.6589009</td>
<td>1.2668363</td>
<td>0.1201222</td>
<td>0.2309530</td>
<td>0.0658876</td>
<td>0.8867806</td>
<td>-34.1099078</td>
<td>26.6836336</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0941428</td>
<td>0.5185360</td>
<td>1.1732952</td>
<td>0.0945327</td>
<td>0.2138998</td>
<td>0.0518556</td>
<td>0.9386362</td>
<td>-48.1464047</td>
<td>17.3295217</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0801775</td>
<td>0.3945866</td>
<td>1.0867750</td>
<td>0.0719359</td>
<td>0.1981266</td>
<td>0.0394572</td>
<td>0.9780933</td>
<td>-60.5413434</td>
<td>8.6774970</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597666</td>
<td>0.2190584</td>
<td>1.0</td>
<td>0.0399359</td>
<td>0.1823069</td>
<td>0.0219067</td>
<td>1.0</td>
<td>-78.0941597</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[106]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&lt;bound method H2OBinomialModel.tnr of &gt;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[107]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">tpr</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Model Details
=============
H2OStackedEnsembleEstimator : Stacked Ensemble
Model Key: StackedEnsemble_AllModels_0_AutoML_20181120_154205
No model summary for this model
ModelMetricsBinomialGLM: stackedensemble
** Reported on train data. **
MSE: 0.12685990330985406
RMSE: 0.3561739789904002
LogLoss: 0.40703958453227496
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124374.13927893189
Residual deviance: 106607.73758484815
AIC: 106631.73758484815
AUC: 0.7734040182726795
Gini: 0.5468080365453589
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21708051286464972:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>83212.0</td>
<td>23869.0</td>
<td>0.2229</td>
<td> (23869.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9376.0</td>
<td>14498.0</td>
<td>0.3927</td>
<td> (9376.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>92588.0</td>
<td>38367.0</td>
<td>0.2539</td>
<td> (33245.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.2170805</td>
<td>0.4658666</td>
<td>238.0</td></tr>
<tr><td>max f2</td>
<td>0.1410190</td>
<td>0.6067433</td>
<td>309.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3338429</td>
<td>0.4568693</td>
<td>155.0</td></tr>
<tr><td>max accuracy</td>
<td>0.4390853</td>
<td>0.8290100</td>
<td>98.0</td></tr>
<tr><td>max precision</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0676438</td>
<td>1.0</td>
<td>394.0</td></tr>
<tr><td>max specificity</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2335835</td>
<td>0.3269004</td>
<td>224.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1855661</td>
<td>0.6993958</td>
<td>265.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1761337</td>
<td>0.7006208</td>
<td>274.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5809896</td>
<td>4.2290904</td>
<td>4.2290904</td>
<td>0.7709924</td>
<td>0.7709924</td>
<td>0.0423054</td>
<td>0.0423054</td>
<td>322.9090447</td>
<td>322.9090447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5350310</td>
<td>3.4879528</td>
<td>3.8585216</td>
<td>0.6358779</td>
<td>0.7034351</td>
<td>0.0348915</td>
<td>0.0771970</td>
<td>248.7952815</td>
<td>285.8521631</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.5007744</td>
<td>3.1972882</td>
<td>3.6382227</td>
<td>0.5828877</td>
<td>0.6632731</td>
<td>0.0319595</td>
<td>0.1091564</td>
<td>219.7288214</td>
<td>263.8222689</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4718430</td>
<td>2.9436144</td>
<td>3.4645375</td>
<td>0.5366412</td>
<td>0.6316091</td>
<td>0.0294463</td>
<td>0.1386027</td>
<td>194.3614440</td>
<td>246.4537481</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4483865</td>
<td>2.8704357</td>
<td>3.3457716</td>
<td>0.5233002</td>
<td>0.6099572</td>
<td>0.0286923</td>
<td>0.1672950</td>
<td>187.0435684</td>
<td>234.5771560</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3623038</td>
<td>2.4444070</td>
<td>2.8950893</td>
<td>0.4456323</td>
<td>0.5277947</td>
<td>0.1222250</td>
<td>0.2895200</td>
<td>144.4406963</td>
<td>189.5089261</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.3079302</td>
<td>1.9878608</td>
<td>2.5926798</td>
<td>0.3624007</td>
<td>0.4726634</td>
<td>0.0993968</td>
<td>0.3889168</td>
<td>98.7860769</td>
<td>159.2679764</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2684456</td>
<td>1.7116814</td>
<td>2.3724554</td>
<td>0.3120513</td>
<td>0.4325150</td>
<td>0.0855743</td>
<td>0.4744911</td>
<td>71.1681359</td>
<td>137.2455391</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2132009</td>
<td>1.4102670</td>
<td>2.0517178</td>
<td>0.2571014</td>
<td>0.3740423</td>
<td>0.1410321</td>
<td>0.6155232</td>
<td>41.0267006</td>
<td>105.1717765</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1765625</td>
<td>1.1217652</td>
<td>1.8192385</td>
<td>0.2045055</td>
<td>0.3316597</td>
<td>0.1121722</td>
<td>0.7276954</td>
<td>12.1765206</td>
<td>81.9238502</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1503145</td>
<td>0.8745582</td>
<td>1.6302967</td>
<td>0.1594380</td>
<td>0.2972143</td>
<td>0.0874592</td>
<td>0.8151546</td>
<td>-12.5441786</td>
<td>63.0296674</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1300345</td>
<td>0.6769128</td>
<td>1.4714054</td>
<td>0.1234059</td>
<td>0.2682474</td>
<td>0.0676887</td>
<td>0.8828433</td>
<td>-32.3087165</td>
<td>47.1405434</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1129563</td>
<td>0.4959559</td>
<td>1.3320601</td>
<td>0.0904162</td>
<td>0.2428437</td>
<td>0.0495937</td>
<td>0.9324370</td>
<td>-50.4044061</td>
<td>33.2060067</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0978849</td>
<td>0.3920433</td>
<td>1.2145535</td>
<td>0.0714722</td>
<td>0.2214215</td>
<td>0.0392058</td>
<td>0.9716428</td>
<td>-60.7956663</td>
<td>21.4553489</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0824531</td>
<td>0.2194940</td>
<td>1.1039951</td>
<td>0.0400153</td>
<td>0.2012659</td>
<td>0.0219486</td>
<td>0.9935914</td>
<td>-78.0505987</td>
<td>10.3995078</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597755</td>
<td>0.0640840</td>
<td>1.0</td>
<td>0.0116830</td>
<td>0.1823069</td>
<td>0.0064086</td>
<td>1.0</td>
<td>-93.5915993</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on validation data. **
MSE: 0.13813682407268132
RMSE: 0.37166762580655494
LogLoss: 0.4379927029517987
Null degrees of freedom: 33031
Residual degrees of freedom: 33020
Null deviance: 31732.354674481932
Residual deviance: 28935.54992780763
AIC: 28959.54992780763
AUC: 0.7122628231156057
Gini: 0.4245256462312115
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.18933454821029921:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>18652.0</td>
<td>8238.0</td>
<td>0.3064</td>
<td> (8238.0/26890.0)</td></tr>
<tr><td>1</td>
<td>2386.0</td>
<td>3756.0</td>
<td>0.3885</td>
<td> (2386.0/6142.0)</td></tr>
<tr><td>Total</td>
<td>21038.0</td>
<td>11994.0</td>
<td>0.3216</td>
<td> (10624.0/33032.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1893345</td>
<td>0.4142038</td>
<td>256.0</td></tr>
<tr><td>max f2</td>
<td>0.1197407</td>
<td>0.5738535</td>
<td>330.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3129965</td>
<td>0.3817812</td>
<td>160.0</td></tr>
<tr><td>max accuracy</td>
<td>0.6010242</td>
<td>0.8160572</td>
<td>29.0</td></tr>
<tr><td>max precision</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0640080</td>
<td>1.0</td>
<td>398.0</td></tr>
<tr><td>max specificity</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2092723</td>
<td>0.2475688</td>
<td>238.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1762849</td>
<td>0.6525562</td>
<td>268.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1577331</td>
<td>0.6547886</td>
<td>286.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.59 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100206</td>
<td>0.5783690</td>
<td>3.1358434</td>
<td>3.1358434</td>
<td>0.5830816</td>
<td>0.5830816</td>
<td>0.0314230</td>
<td>0.0314230</td>
<td>213.5843447</td>
<td>213.5843447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200109</td>
<td>0.5293169</td>
<td>2.5749465</td>
<td>2.8558192</td>
<td>0.4787879</td>
<td>0.5310136</td>
<td>0.0257245</td>
<td>0.0571475</td>
<td>157.4946469</td>
<td>185.5819237</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300012</td>
<td>0.4955180</td>
<td>2.4119752</td>
<td>2.7080205</td>
<td>0.4484848</td>
<td>0.5035318</td>
<td>0.0240964</td>
<td>0.0812439</td>
<td>141.1975173</td>
<td>170.8020508</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400218</td>
<td>0.4688250</td>
<td>2.4859277</td>
<td>2.6524133</td>
<td>0.4622356</td>
<td>0.4931921</td>
<td>0.0249105</td>
<td>0.1061543</td>
<td>148.5927707</td>
<td>165.2413309</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500121</td>
<td>0.4455599</td>
<td>2.2164096</td>
<td>2.5653181</td>
<td>0.4121212</td>
<td>0.4769976</td>
<td>0.0221426</td>
<td>0.1282970</td>
<td>121.6409619</td>
<td>156.5318141</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000242</td>
<td>0.3612868</td>
<td>2.0607188</td>
<td>2.3130185</td>
<td>0.3831719</td>
<td>0.4300847</td>
<td>0.1030609</td>
<td>0.2313579</td>
<td>106.0718760</td>
<td>131.3018450</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500061</td>
<td>0.3068785</td>
<td>1.7850835</td>
<td>2.1371112</td>
<td>0.3319200</td>
<td>0.3973764</td>
<td>0.0892218</td>
<td>0.3205796</td>
<td>78.5083530</td>
<td>113.7111174</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2000182</td>
<td>0.2675737</td>
<td>1.5756523</td>
<td>1.9967252</td>
<td>0.2929782</td>
<td>0.3712729</td>
<td>0.0788017</td>
<td>0.3993813</td>
<td>57.5652259</td>
<td>99.6725200</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000121</td>
<td>0.2132448</td>
<td>1.3758567</td>
<td>1.7897899</td>
<td>0.2558280</td>
<td>0.3327952</td>
<td>0.1375773</td>
<td>0.5369586</td>
<td>37.5856668</td>
<td>78.9789907</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4000061</td>
<td>0.1764937</td>
<td>1.1299935</td>
<td>1.6248533</td>
<td>0.2101120</td>
<td>0.3021267</td>
<td>0.1129925</td>
<td>0.6499512</td>
<td>12.9993524</td>
<td>62.4853295</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5</td>
<td>0.1497263</td>
<td>0.9964784</td>
<td>1.4991859</td>
<td>0.1852861</td>
<td>0.2787600</td>
<td>0.0996418</td>
<td>0.7495930</td>
<td>-0.3521561</td>
<td>49.9185933</td></tr>
<tr><td></td>
<td>12</td>
<td>0.5999939</td>
<td>0.1296393</td>
<td>0.7587565</td>
<td>1.3757872</td>
<td>0.1410839</td>
<td>0.2558151</td>
<td>0.0758711</td>
<td>0.8254640</td>
<td>-24.1243542</td>
<td>37.5787247</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999879</td>
<td>0.1130667</td>
<td>0.6284978</td>
<td>1.2690362</td>
<td>0.1168635</td>
<td>0.2359657</td>
<td>0.0628460</td>
<td>0.8883100</td>
<td>-37.1502161</td>
<td>26.9036234</td></tr>
<tr><td></td>
<td>14</td>
<td>0.7999818</td>
<td>0.0982229</td>
<td>0.5259192</td>
<td>1.1761501</td>
<td>0.0977899</td>
<td>0.2186944</td>
<td>0.0525887</td>
<td>0.9408987</td>
<td>-47.4080824</td>
<td>17.6150117</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999758</td>
<td>0.0826149</td>
<td>0.3989170</td>
<td>1.0897938</td>
<td>0.0741750</td>
<td>0.2026372</td>
<td>0.0398893</td>
<td>0.9807880</td>
<td>-60.1082978</td>
<td>8.9793790</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0605773</td>
<td>0.1920733</td>
<td>1.0</td>
<td>0.0357143</td>
<td>0.1859409</td>
<td>0.0192120</td>
<td>1.0</td>
<td>-80.7926687</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on cross-validation data. **
MSE: 0.1369765435568584
RMSE: 0.3701034227845757
LogLoss: 0.4355309009590542
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124375.46514588114
Residual deviance: 114069.89827018589
AIC: 114093.89827018589
AUC: 0.7071203432205223
Gini: 0.4142406864410446
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.17843972441369682:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>73561.0</td>
<td>33520.0</td>
<td>0.313</td>
<td> (33520.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9215.0</td>
<td>14659.0</td>
<td>0.386</td>
<td> (9215.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>82776.0</td>
<td>48179.0</td>
<td>0.3263</td>
<td> (42735.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1784397</td>
<td>0.4068949</td>
<td>261.0</td></tr>
<tr><td>max f2</td>
<td>0.1136746</td>
<td>0.5665672</td>
<td>334.0</td></tr>
<tr><td>max f0point5</td>
<td>0.2879939</td>
<td>0.3708050</td>
<td>176.0</td></tr>
<tr><td>max accuracy</td>
<td>0.5663591</td>
<td>0.8184567</td>
<td>36.0</td></tr>
<tr><td>max precision</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0620870</td>
<td>1.0</td>
<td>399.0</td></tr>
<tr><td>max specificity</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.1815977</td>
<td>0.2412252</td>
<td>258.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1671726</td>
<td>0.6498819</td>
<td>272.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1616542</td>
<td>0.6512829</td>
<td>278.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5609815</td>
<td>2.9394272</td>
<td>2.9394272</td>
<td>0.5358779</td>
<td>0.5358779</td>
<td>0.0294044</td>
<td>0.0294044</td>
<td>193.9427222</td>
<td>193.9427222</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5136764</td>
<td>2.6044498</td>
<td>2.7719385</td>
<td>0.4748092</td>
<td>0.5053435</td>
<td>0.0260534</td>
<td>0.0554578</td>
<td>160.4449761</td>
<td>177.1938491</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.4802174</td>
<td>2.4346323</td>
<td>2.6595603</td>
<td>0.4438503</td>
<td>0.4848562</td>
<td>0.0243361</td>
<td>0.0797939</td>
<td>143.4632310</td>
<td>165.9560331</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4541967</td>
<td>2.2987828</td>
<td>2.5693487</td>
<td>0.4190840</td>
<td>0.4684100</td>
<td>0.0229957</td>
<td>0.1027896</td>
<td>129.8782827</td>
<td>156.9348739</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4304407</td>
<td>2.3592048</td>
<td>2.5273392</td>
<td>0.4300993</td>
<td>0.4607514</td>
<td>0.0235821</td>
<td>0.1263718</td>
<td>135.9204803</td>
<td>152.7339208</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3489922</td>
<td>2.0674422</td>
<td>2.2973907</td>
<td>0.3769090</td>
<td>0.4188302</td>
<td>0.1033761</td>
<td>0.2297478</td>
<td>106.7442216</td>
<td>129.7390712</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.2957391</td>
<td>1.7583311</td>
<td>2.1177042</td>
<td>0.3205559</td>
<td>0.3860721</td>
<td>0.0879199</td>
<td>0.3176678</td>
<td>75.8331123</td>
<td>111.7704182</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2569097</td>
<td>1.5826559</td>
<td>1.9839574</td>
<td>0.2885291</td>
<td>0.3616891</td>
<td>0.0791237</td>
<td>0.3967915</td>
<td>58.2655941</td>
<td>98.3957443</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2032167</td>
<td>1.3679632</td>
<td>1.7786208</td>
<td>0.2493891</td>
<td>0.3242548</td>
<td>0.1368015</td>
<td>0.5335930</td>
<td>36.7963184</td>
<td>77.8620797</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1679941</td>
<td>1.1284673</td>
<td>1.6160886</td>
<td>0.2057274</td>
<td>0.2946241</td>
<td>0.1128424</td>
<td>0.6464355</td>
<td>12.8467313</td>
<td>61.6088632</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1428590</td>
<td>0.9302652</td>
<td>1.4789198</td>
<td>0.1695938</td>
<td>0.2696173</td>
<td>0.0930301</td>
<td>0.7394655</td>
<td>-6.9734773</td>
<td>47.8919761</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1238863</td>
<td>0.8143060</td>
<td>1.3681550</td>
<td>0.1484536</td>
<td>0.2494241</td>
<td>0.0814275</td>
<td>0.8208930</td>
<td>-18.5693965</td>
<td>36.8155036</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1081113</td>
<td>0.6589009</td>
<td>1.2668363</td>
<td>0.1201222</td>
<td>0.2309530</td>
<td>0.0658876</td>
<td>0.8867806</td>
<td>-34.1099078</td>
<td>26.6836336</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0941428</td>
<td>0.5185360</td>
<td>1.1732952</td>
<td>0.0945327</td>
<td>0.2138998</td>
<td>0.0518556</td>
<td>0.9386362</td>
<td>-48.1464047</td>
<td>17.3295217</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0801775</td>
<td>0.3945866</td>
<td>1.0867750</td>
<td>0.0719359</td>
<td>0.1981266</td>
<td>0.0394572</td>
<td>0.9780933</td>
<td>-60.5413434</td>
<td>8.6774970</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597666</td>
<td>0.2190584</td>
<td>1.0</td>
<td>0.0399359</td>
<td>0.1823069</td>
<td>0.0219067</td>
<td>1.0</td>
<td>-78.0941597</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[107]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&lt;bound method H2OBinomialModel.tpr of &gt;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing code_cell rendered">
<div class="input">
<div class="prompt input_prompt">In&nbsp;[108]:</div>
<div class="inner_cell">
<div class="input_area">
<div class=" highlight hl-ipython3"><pre><span></span><span class="n">aml</span><span class="o">.</span><span class="n">leader</span><span class="o">.</span><span class="n">weights</span>
</pre></div>
</div>
</div>
</div>
<div class="output_wrapper">
<div class="output">
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Model Details
=============
H2OStackedEnsembleEstimator : Stacked Ensemble
Model Key: StackedEnsemble_AllModels_0_AutoML_20181120_154205
No model summary for this model
ModelMetricsBinomialGLM: stackedensemble
** Reported on train data. **
MSE: 0.12685990330985406
RMSE: 0.3561739789904002
LogLoss: 0.40703958453227496
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124374.13927893189
Residual deviance: 106607.73758484815
AIC: 106631.73758484815
AUC: 0.7734040182726795
Gini: 0.5468080365453589
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.21708051286464972:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>83212.0</td>
<td>23869.0</td>
<td>0.2229</td>
<td> (23869.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9376.0</td>
<td>14498.0</td>
<td>0.3927</td>
<td> (9376.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>92588.0</td>
<td>38367.0</td>
<td>0.2539</td>
<td> (33245.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.2170805</td>
<td>0.4658666</td>
<td>238.0</td></tr>
<tr><td>max f2</td>
<td>0.1410190</td>
<td>0.6067433</td>
<td>309.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3338429</td>
<td>0.4568693</td>
<td>155.0</td></tr>
<tr><td>max accuracy</td>
<td>0.4390853</td>
<td>0.8290100</td>
<td>98.0</td></tr>
<tr><td>max precision</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0676438</td>
<td>1.0</td>
<td>394.0</td></tr>
<tr><td>max specificity</td>
<td>0.8006766</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2335835</td>
<td>0.3269004</td>
<td>224.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1855661</td>
<td>0.6993958</td>
<td>265.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1761337</td>
<td>0.7006208</td>
<td>274.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5809896</td>
<td>4.2290904</td>
<td>4.2290904</td>
<td>0.7709924</td>
<td>0.7709924</td>
<td>0.0423054</td>
<td>0.0423054</td>
<td>322.9090447</td>
<td>322.9090447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5350310</td>
<td>3.4879528</td>
<td>3.8585216</td>
<td>0.6358779</td>
<td>0.7034351</td>
<td>0.0348915</td>
<td>0.0771970</td>
<td>248.7952815</td>
<td>285.8521631</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.5007744</td>
<td>3.1972882</td>
<td>3.6382227</td>
<td>0.5828877</td>
<td>0.6632731</td>
<td>0.0319595</td>
<td>0.1091564</td>
<td>219.7288214</td>
<td>263.8222689</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4718430</td>
<td>2.9436144</td>
<td>3.4645375</td>
<td>0.5366412</td>
<td>0.6316091</td>
<td>0.0294463</td>
<td>0.1386027</td>
<td>194.3614440</td>
<td>246.4537481</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4483865</td>
<td>2.8704357</td>
<td>3.3457716</td>
<td>0.5233002</td>
<td>0.6099572</td>
<td>0.0286923</td>
<td>0.1672950</td>
<td>187.0435684</td>
<td>234.5771560</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3623038</td>
<td>2.4444070</td>
<td>2.8950893</td>
<td>0.4456323</td>
<td>0.5277947</td>
<td>0.1222250</td>
<td>0.2895200</td>
<td>144.4406963</td>
<td>189.5089261</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.3079302</td>
<td>1.9878608</td>
<td>2.5926798</td>
<td>0.3624007</td>
<td>0.4726634</td>
<td>0.0993968</td>
<td>0.3889168</td>
<td>98.7860769</td>
<td>159.2679764</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2684456</td>
<td>1.7116814</td>
<td>2.3724554</td>
<td>0.3120513</td>
<td>0.4325150</td>
<td>0.0855743</td>
<td>0.4744911</td>
<td>71.1681359</td>
<td>137.2455391</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2132009</td>
<td>1.4102670</td>
<td>2.0517178</td>
<td>0.2571014</td>
<td>0.3740423</td>
<td>0.1410321</td>
<td>0.6155232</td>
<td>41.0267006</td>
<td>105.1717765</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1765625</td>
<td>1.1217652</td>
<td>1.8192385</td>
<td>0.2045055</td>
<td>0.3316597</td>
<td>0.1121722</td>
<td>0.7276954</td>
<td>12.1765206</td>
<td>81.9238502</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1503145</td>
<td>0.8745582</td>
<td>1.6302967</td>
<td>0.1594380</td>
<td>0.2972143</td>
<td>0.0874592</td>
<td>0.8151546</td>
<td>-12.5441786</td>
<td>63.0296674</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1300345</td>
<td>0.6769128</td>
<td>1.4714054</td>
<td>0.1234059</td>
<td>0.2682474</td>
<td>0.0676887</td>
<td>0.8828433</td>
<td>-32.3087165</td>
<td>47.1405434</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1129563</td>
<td>0.4959559</td>
<td>1.3320601</td>
<td>0.0904162</td>
<td>0.2428437</td>
<td>0.0495937</td>
<td>0.9324370</td>
<td>-50.4044061</td>
<td>33.2060067</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0978849</td>
<td>0.3920433</td>
<td>1.2145535</td>
<td>0.0714722</td>
<td>0.2214215</td>
<td>0.0392058</td>
<td>0.9716428</td>
<td>-60.7956663</td>
<td>21.4553489</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0824531</td>
<td>0.2194940</td>
<td>1.1039951</td>
<td>0.0400153</td>
<td>0.2012659</td>
<td>0.0219486</td>
<td>0.9935914</td>
<td>-78.0505987</td>
<td>10.3995078</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597755</td>
<td>0.0640840</td>
<td>1.0</td>
<td>0.0116830</td>
<td>0.1823069</td>
<td>0.0064086</td>
<td>1.0</td>
<td>-93.5915993</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on validation data. **
MSE: 0.13813682407268132
RMSE: 0.37166762580655494
LogLoss: 0.4379927029517987
Null degrees of freedom: 33031
Residual degrees of freedom: 33020
Null deviance: 31732.354674481932
Residual deviance: 28935.54992780763
AIC: 28959.54992780763
AUC: 0.7122628231156057
Gini: 0.4245256462312115
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.18933454821029921:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>18652.0</td>
<td>8238.0</td>
<td>0.3064</td>
<td> (8238.0/26890.0)</td></tr>
<tr><td>1</td>
<td>2386.0</td>
<td>3756.0</td>
<td>0.3885</td>
<td> (2386.0/6142.0)</td></tr>
<tr><td>Total</td>
<td>21038.0</td>
<td>11994.0</td>
<td>0.3216</td>
<td> (10624.0/33032.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1893345</td>
<td>0.4142038</td>
<td>256.0</td></tr>
<tr><td>max f2</td>
<td>0.1197407</td>
<td>0.5738535</td>
<td>330.0</td></tr>
<tr><td>max f0point5</td>
<td>0.3129965</td>
<td>0.3817812</td>
<td>160.0</td></tr>
<tr><td>max accuracy</td>
<td>0.6010242</td>
<td>0.8160572</td>
<td>29.0</td></tr>
<tr><td>max precision</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0640080</td>
<td>1.0</td>
<td>398.0</td></tr>
<tr><td>max specificity</td>
<td>0.7666583</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.2092723</td>
<td>0.2475688</td>
<td>238.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1762849</td>
<td>0.6525562</td>
<td>268.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1577331</td>
<td>0.6547886</td>
<td>286.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.59 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100206</td>
<td>0.5783690</td>
<td>3.1358434</td>
<td>3.1358434</td>
<td>0.5830816</td>
<td>0.5830816</td>
<td>0.0314230</td>
<td>0.0314230</td>
<td>213.5843447</td>
<td>213.5843447</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200109</td>
<td>0.5293169</td>
<td>2.5749465</td>
<td>2.8558192</td>
<td>0.4787879</td>
<td>0.5310136</td>
<td>0.0257245</td>
<td>0.0571475</td>
<td>157.4946469</td>
<td>185.5819237</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300012</td>
<td>0.4955180</td>
<td>2.4119752</td>
<td>2.7080205</td>
<td>0.4484848</td>
<td>0.5035318</td>
<td>0.0240964</td>
<td>0.0812439</td>
<td>141.1975173</td>
<td>170.8020508</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400218</td>
<td>0.4688250</td>
<td>2.4859277</td>
<td>2.6524133</td>
<td>0.4622356</td>
<td>0.4931921</td>
<td>0.0249105</td>
<td>0.1061543</td>
<td>148.5927707</td>
<td>165.2413309</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500121</td>
<td>0.4455599</td>
<td>2.2164096</td>
<td>2.5653181</td>
<td>0.4121212</td>
<td>0.4769976</td>
<td>0.0221426</td>
<td>0.1282970</td>
<td>121.6409619</td>
<td>156.5318141</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000242</td>
<td>0.3612868</td>
<td>2.0607188</td>
<td>2.3130185</td>
<td>0.3831719</td>
<td>0.4300847</td>
<td>0.1030609</td>
<td>0.2313579</td>
<td>106.0718760</td>
<td>131.3018450</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500061</td>
<td>0.3068785</td>
<td>1.7850835</td>
<td>2.1371112</td>
<td>0.3319200</td>
<td>0.3973764</td>
<td>0.0892218</td>
<td>0.3205796</td>
<td>78.5083530</td>
<td>113.7111174</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2000182</td>
<td>0.2675737</td>
<td>1.5756523</td>
<td>1.9967252</td>
<td>0.2929782</td>
<td>0.3712729</td>
<td>0.0788017</td>
<td>0.3993813</td>
<td>57.5652259</td>
<td>99.6725200</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000121</td>
<td>0.2132448</td>
<td>1.3758567</td>
<td>1.7897899</td>
<td>0.2558280</td>
<td>0.3327952</td>
<td>0.1375773</td>
<td>0.5369586</td>
<td>37.5856668</td>
<td>78.9789907</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4000061</td>
<td>0.1764937</td>
<td>1.1299935</td>
<td>1.6248533</td>
<td>0.2101120</td>
<td>0.3021267</td>
<td>0.1129925</td>
<td>0.6499512</td>
<td>12.9993524</td>
<td>62.4853295</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5</td>
<td>0.1497263</td>
<td>0.9964784</td>
<td>1.4991859</td>
<td>0.1852861</td>
<td>0.2787600</td>
<td>0.0996418</td>
<td>0.7495930</td>
<td>-0.3521561</td>
<td>49.9185933</td></tr>
<tr><td></td>
<td>12</td>
<td>0.5999939</td>
<td>0.1296393</td>
<td>0.7587565</td>
<td>1.3757872</td>
<td>0.1410839</td>
<td>0.2558151</td>
<td>0.0758711</td>
<td>0.8254640</td>
<td>-24.1243542</td>
<td>37.5787247</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999879</td>
<td>0.1130667</td>
<td>0.6284978</td>
<td>1.2690362</td>
<td>0.1168635</td>
<td>0.2359657</td>
<td>0.0628460</td>
<td>0.8883100</td>
<td>-37.1502161</td>
<td>26.9036234</td></tr>
<tr><td></td>
<td>14</td>
<td>0.7999818</td>
<td>0.0982229</td>
<td>0.5259192</td>
<td>1.1761501</td>
<td>0.0977899</td>
<td>0.2186944</td>
<td>0.0525887</td>
<td>0.9408987</td>
<td>-47.4080824</td>
<td>17.6150117</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999758</td>
<td>0.0826149</td>
<td>0.3989170</td>
<td>1.0897938</td>
<td>0.0741750</td>
<td>0.2026372</td>
<td>0.0398893</td>
<td>0.9807880</td>
<td>-60.1082978</td>
<td>8.9793790</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0605773</td>
<td>0.1920733</td>
<td>1.0</td>
<td>0.0357143</td>
<td>0.1859409</td>
<td>0.0192120</td>
<td>1.0</td>
<td>-80.7926687</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
ModelMetricsBinomialGLM: stackedensemble
** Reported on cross-validation data. **
MSE: 0.1369765435568584
RMSE: 0.3701034227845757
LogLoss: 0.4355309009590542
Null degrees of freedom: 130954
Residual degrees of freedom: 130943
Null deviance: 124375.46514588114
Residual deviance: 114069.89827018589
AIC: 114093.89827018589
AUC: 0.7071203432205223
Gini: 0.4142406864410446
Confusion Matrix (Act/Pred) for max f1 @ threshold = 0.17843972441369682:
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>0</b></td>
<td><b>1</b></td>
<td><b>Error</b></td>
<td><b>Rate</b></td></tr>
<tr><td>0</td>
<td>73561.0</td>
<td>33520.0</td>
<td>0.313</td>
<td> (33520.0/107081.0)</td></tr>
<tr><td>1</td>
<td>9215.0</td>
<td>14659.0</td>
<td>0.386</td>
<td> (9215.0/23874.0)</td></tr>
<tr><td>Total</td>
<td>82776.0</td>
<td>48179.0</td>
<td>0.3263</td>
<td> (42735.0/130955.0)</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Maximum Metrics: Maximum metrics at their respective thresholds
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b>metric</b></td>
<td><b>threshold</b></td>
<td><b>value</b></td>
<td><b>idx</b></td></tr>
<tr><td>max f1</td>
<td>0.1784397</td>
<td>0.4068949</td>
<td>261.0</td></tr>
<tr><td>max f2</td>
<td>0.1136746</td>
<td>0.5665672</td>
<td>334.0</td></tr>
<tr><td>max f0point5</td>
<td>0.2879939</td>
<td>0.3708050</td>
<td>176.0</td></tr>
<tr><td>max accuracy</td>
<td>0.5663591</td>
<td>0.8184567</td>
<td>36.0</td></tr>
<tr><td>max precision</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max recall</td>
<td>0.0620870</td>
<td>1.0</td>
<td>399.0</td></tr>
<tr><td>max specificity</td>
<td>0.7859236</td>
<td>1.0</td>
<td>0.0</td></tr>
<tr><td>max absolute_mcc</td>
<td>0.1815977</td>
<td>0.2412252</td>
<td>258.0</td></tr>
<tr><td>max min_per_class_accuracy</td>
<td>0.1671726</td>
<td>0.6498819</td>
<td>272.0</td></tr>
<tr><td>max mean_per_class_accuracy</td>
<td>0.1616542</td>
<td>0.6512829</td>
<td>278.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>Gains/Lift Table: Avg response rate: 18.23 %
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_html rendered_html output_subarea ">
<div style="overflow:auto"><table style="width:50%"><tr><td><b></b></td>
<td><b>group</b></td>
<td><b>cumulative_data_fraction</b></td>
<td><b>lower_threshold</b></td>
<td><b>lift</b></td>
<td><b>cumulative_lift</b></td>
<td><b>response_rate</b></td>
<td><b>cumulative_response_rate</b></td>
<td><b>capture_rate</b></td>
<td><b>cumulative_capture_rate</b></td>
<td><b>gain</b></td>
<td><b>cumulative_gain</b></td></tr>
<tr><td></td>
<td>1</td>
<td>0.0100034</td>
<td>0.5609815</td>
<td>2.9394272</td>
<td>2.9394272</td>
<td>0.5358779</td>
<td>0.5358779</td>
<td>0.0294044</td>
<td>0.0294044</td>
<td>193.9427222</td>
<td>193.9427222</td></tr>
<tr><td></td>
<td>2</td>
<td>0.0200069</td>
<td>0.5136764</td>
<td>2.6044498</td>
<td>2.7719385</td>
<td>0.4748092</td>
<td>0.5053435</td>
<td>0.0260534</td>
<td>0.0554578</td>
<td>160.4449761</td>
<td>177.1938491</td></tr>
<tr><td></td>
<td>3</td>
<td>0.0300027</td>
<td>0.4802174</td>
<td>2.4346323</td>
<td>2.6595603</td>
<td>0.4438503</td>
<td>0.4848562</td>
<td>0.0243361</td>
<td>0.0797939</td>
<td>143.4632310</td>
<td>165.9560331</td></tr>
<tr><td></td>
<td>4</td>
<td>0.0400061</td>
<td>0.4541967</td>
<td>2.2987828</td>
<td>2.5693487</td>
<td>0.4190840</td>
<td>0.4684100</td>
<td>0.0229957</td>
<td>0.1027896</td>
<td>129.8782827</td>
<td>156.9348739</td></tr>
<tr><td></td>
<td>5</td>
<td>0.0500019</td>
<td>0.4304407</td>
<td>2.3592048</td>
<td>2.5273392</td>
<td>0.4300993</td>
<td>0.4607514</td>
<td>0.0235821</td>
<td>0.1263718</td>
<td>135.9204803</td>
<td>152.7339208</td></tr>
<tr><td></td>
<td>6</td>
<td>0.1000038</td>
<td>0.3489922</td>
<td>2.0674422</td>
<td>2.2973907</td>
<td>0.3769090</td>
<td>0.4188302</td>
<td>0.1033761</td>
<td>0.2297478</td>
<td>106.7442216</td>
<td>129.7390712</td></tr>
<tr><td></td>
<td>7</td>
<td>0.1500057</td>
<td>0.2957391</td>
<td>1.7583311</td>
<td>2.1177042</td>
<td>0.3205559</td>
<td>0.3860721</td>
<td>0.0879199</td>
<td>0.3176678</td>
<td>75.8331123</td>
<td>111.7704182</td></tr>
<tr><td></td>
<td>8</td>
<td>0.2</td>
<td>0.2569097</td>
<td>1.5826559</td>
<td>1.9839574</td>
<td>0.2885291</td>
<td>0.3616891</td>
<td>0.0791237</td>
<td>0.3967915</td>
<td>58.2655941</td>
<td>98.3957443</td></tr>
<tr><td></td>
<td>9</td>
<td>0.3000038</td>
<td>0.2032167</td>
<td>1.3679632</td>
<td>1.7786208</td>
<td>0.2493891</td>
<td>0.3242548</td>
<td>0.1368015</td>
<td>0.5335930</td>
<td>36.7963184</td>
<td>77.8620797</td></tr>
<tr><td></td>
<td>10</td>
<td>0.4</td>
<td>0.1679941</td>
<td>1.1284673</td>
<td>1.6160886</td>
<td>0.2057274</td>
<td>0.2946241</td>
<td>0.1128424</td>
<td>0.6464355</td>
<td>12.8467313</td>
<td>61.6088632</td></tr>
<tr><td></td>
<td>11</td>
<td>0.5000038</td>
<td>0.1428590</td>
<td>0.9302652</td>
<td>1.4789198</td>
<td>0.1695938</td>
<td>0.2696173</td>
<td>0.0930301</td>
<td>0.7394655</td>
<td>-6.9734773</td>
<td>47.8919761</td></tr>
<tr><td></td>
<td>12</td>
<td>0.6</td>
<td>0.1238863</td>
<td>0.8143060</td>
<td>1.3681550</td>
<td>0.1484536</td>
<td>0.2494241</td>
<td>0.0814275</td>
<td>0.8208930</td>
<td>-18.5693965</td>
<td>36.8155036</td></tr>
<tr><td></td>
<td>13</td>
<td>0.6999962</td>
<td>0.1081113</td>
<td>0.6589009</td>
<td>1.2668363</td>
<td>0.1201222</td>
<td>0.2309530</td>
<td>0.0658876</td>
<td>0.8867806</td>
<td>-34.1099078</td>
<td>26.6836336</td></tr>
<tr><td></td>
<td>14</td>
<td>0.8</td>
<td>0.0941428</td>
<td>0.5185360</td>
<td>1.1732952</td>
<td>0.0945327</td>
<td>0.2138998</td>
<td>0.0518556</td>
<td>0.9386362</td>
<td>-48.1464047</td>
<td>17.3295217</td></tr>
<tr><td></td>
<td>15</td>
<td>0.8999962</td>
<td>0.0801775</td>
<td>0.3945866</td>
<td>1.0867750</td>
<td>0.0719359</td>
<td>0.1981266</td>
<td>0.0394572</td>
<td>0.9780933</td>
<td>-60.5413434</td>
<td>8.6774970</td></tr>
<tr><td></td>
<td>16</td>
<td>1.0</td>
<td>0.0597666</td>
<td>0.2190584</td>
<td>1.0</td>
<td>0.0399359</td>
<td>0.1823069</td>
<td>0.0219067</td>
<td>1.0</td>
<td>-78.0941597</td>
<td>0.0</td></tr></table></div>
</div>
</div>
<div class="output_area">
<div class="prompt"></div>
<div class="output_subarea output_stream output_stdout output_text">
<pre>
</pre>
</div>
</div>
<div class="output_area">
<div class="prompt output_prompt">Out[108]:</div>
<div class="output_text output_subarea output_execute_result">
<pre>&lt;bound method ModelBase.weights of &gt;</pre>
</div>
</div>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h3 id="Test-Data-Sets-for-Binary-Classifier">Test Data Sets for Binary Classifier<a class="anchor-link" href="#Test-Data-Sets-for-Binary-Classifier">&#182;</a></h3><h4 id="Some-Kaggle-Binary-classification-competitions">Some Kaggle Binary classification competitions<a class="anchor-link" href="#Some-Kaggle-Binary-classification-competitions">&#182;</a></h4><p>The idea here is to get a range of datasets to test our H2O binary classification models as well as to understand which approaches work best for binary classification. The hope is to get a single model or set of models that perform well in these competitions as well as logic and tests to dynamically choose the best models and their parameters.</p>
<p><a href="https://www.kaggle.com/c/santander-customer-satisfaction">Santander Customer Satisfaction</a></p>
<p><a href="https://www.kaggle.com/c/facebook-recruiting-iv-human-or-bot">Facebook Recruiting IV: Human or Robot?</a></p>
<p><a href="https://www.kaggle.com/c/donorschoose-application-screening">DonorsChoose.org Application Screening Predict whether teachers' project proposals are accepted</a></p>
<p><a href="https://www.kaggle.com/c/statoil-iceberg-classifier-challenge">Statoil/C-CORE Iceberg Classifier Challenge Ship or iceberg, can you decide from space?</a></p>
<p><a href="https://www.kaggle.com/c/kkbox-churn-prediction-challenge">WSDM - KKBox's Churn Prediction Challenge Can you predict when subscribers will churn?</a></p>
<p><a href="https://www.kaggle.com/c/porto-seguro-safe-driver-prediction">Porto Seguro’s Safe Driver Prediction Predict if a driver will file an insurance claim next year.</a></p>
<p><a href="https://www.kaggle.com/c/dato-native">Porto Seguro’s Safe Driver Prediction Predict if a driver will file an insurance claim next year.</a></p>
<p><a href="https://www.kaggle.com/c/data-science-bowl-2017">Data Science Bowl 2017 Can you improve lung cancer detection?</a></p>
<p><a href="https://www.kaggle.com/c/random-acts-of-pizza">Random Acts of Pizza Predicting altruism through free pizza</a></p>
</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered">
<div class="prompt input_prompt">
</div>
<div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<p>Last update: October 3, 2018</p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>